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The  Home  *£Oeonroee  Research  Qffio#  wi  invited  to  assign 
•olentiflc  advisers  to  Any  group*  responsible  for  tooting  the 
organisation  a nd  doctrine  of  the  new  atonic  field  any  (ATFA).i/ 
Theeo  teete  were  conducted  during  the  FOLLOW  ME,  BUDEBOLT  IX,  and 
SA0S8RDSR  maneuvers  in  195b  and  1955. 

The  purpoee  of  thin  paper  la  to  deecrlb*  and/or  analyse  the 
jiniM  mm  of  oonotroetlog  an  enplrleal  teat  of  the  organisation  and 
doctrine  under  which  an  Any  unit  of  division  or  larger  else  opsr- 
atee.  Although  this  wnrsnrhai  la  ooneemed  primarily  with  the 
largest  of  the  naneuvere,  3ACKHWPH,  the  writer  bellevee  that  the 
tent  nay  be  generalised  to  the  other  two  as  well. 

The  scientific  advice  given  by  the  axnfiRO  representative 
did  not  deal  prlnarlly  with  naasurlag  techniques  such  as  replication. 


general  In  nature.  The  level  of  abstraction  of  the  variables  to  be 
neaeured  was  one  of  the  central  problens  the  Amy  faced  in  con* true t- 
ing  the  SAOBBOS8  test.  In  the  advice  given  in  this  area,  the 
general  scientific  approach  of  identifying  variables  which  predict 
fron  the  abatraot  to  the  epeolflo  wee  applied. 

This  report  describee  the  "false  starts*  with  regard  to  the 
level  of  abstraction  of  the  variables  to  bo  neasurod  during  SAQKBRBSH 


The  writer  wee  not  able  to  find  an  authoritative  source  that 
explained  the  naeniigt  the  tent  A1FA,  It  wee  variously  re- 
ported aa  a contraction  of  atcodLo  field  any  and  A-typo  field 
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rwomU  the  oouneel  given  by  the  HumRRO  scientific  adviser  on 
this  point,  and  disease ee  the  level  of  abstraction  that  should 
be  used  In  the  future  for  predletiws  to  be  canageable  yet  accurate. 
Also  described  are  the  requirements,  in  terns  of  scientific  and 
nllltary  effort,  that  must  be  fulfilled  in  order  to  replace  "artistic 
prophecies*  with  accurate,  scientific  predictions  of  the  effective- 
ness of  various  field-arey  organisations  and  doctrines. 


One  central  aspect  of  the  approach  to  t his  problon  oust 
be  specified.  The  approach  adopted  wee  tint  the  teet  would  have 
to  be  conducted  in  a situation  as  similar  to  combat  as  possible. 
Although  tests  can  be  end  often  are  conducted  in  a much  moors  ab- 
stract setting,  the  approach  taken  for  this  teet  is  common  to  most 
others  that  are  adopted  in  the  Initial  scientific  efforts  in  any 


I e 


The  approach  necessitated  the  construction  of  a t est  cri- 


terion for  the  ATFA  field  army.  This  requirement  was  fulfilled,  in 
general  fora,  by  the  ATTA  field  any  performing  in  SAGEBRUSH.  This 
maneuver  wee  an  Attraction  f rom  actual  combat.  The  objective  of  the 
testing  program  was  to  keep  the  measurements  of  this  field  anqjr  at  as 
Ice  a level  of  abstraction  as  possible  within  the  administrative  re- 
quirements than  in  eads tones. 

Parenthetically,  it  3hould  be  said  that  the  writer  does 
not  sssras  that  a duplication  of  ooobat  rueh  as  SAGEBRUSH  is  neoes- 
sary  in  every  future  teet  situation.  It  was  adopted  in  this  osse 
because  at  present  too  little  is  known  about  the  effects  of  omitting 
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tlM  nrloni  aspects  of  oambat.  As  more  is  learned  about  tbo 
Importance  of  various  oapoota  of  tho  fluid  mgr,  tbo  peripheral 
aspects  oan  bo  omitted, 

Tho  scientific  adrloo  given  to  tbo  Ajraqr  Maneuver  Toot  and 
Evaluation  Group  (AMRO)  oonoomad  tbo  abotraotlono  Arua  ooobat  that 
had  to  bo  made  In  constructing  tho  toat  criterion,  Thla  vaa  a oat  tar 
of  defining  tho  a In  lam  Mount  of  abstraction  noodod  for  tho  oltuatlon 
that  satiated,  Tho  adrloo  woo  definitely  not  In  tho  fbrn  of  uhat  to 
abetrect,  it  daalt  with  how  auch  to  abotraet  and  what  techniques  to 
uao  In  tho  abstracting, 

"Abstractive  pvooooa"  lo  a ganerio  tarn  for  auoh  activi- 
tloa  ao  a Job  analysis,  task  analysis,  aotivJty  analysis,  tsst 
orltorlon  building,  or  Item  development,  As  used  by  behavioral 
solontloto.  It  Is  a proooss  not  llnitod  to  fonaal  areas  auoh  as  training, 
solootlon,  and  loadorahlp0  It  lo  tho  proooas  underlying  tho  discussion 
In  this  paporo 

Co  Historical  Introduction 

1°  Maneuvers,  War  Panes,  and  Omanrt  Post  Raorolacc 

Largo-seals  toots  of  Assy  organisation  and  doctrine  hare 
boon  conducted  during  four  maneuvers,  TRIANGULAR  DIVISION  (1939, 

FOLLOW  MB  (1990,  BLOKBOLT  (1990  and  8A0BBRU8H  (1 955).  Maneuvers 
are  a particular  kind  of  Axmj  exercise,  as  are  war  games  and  ooomand 
post  exercises  (CPX's)o  Tho  following  rule  of  thumb  will  serve  for 
distinguishing  among  the  throe  typos  i 

Mar  games  are  oonduoted  "on  paper,”  Mo  troops  actually 
appear  In  tho  field;  th«y  are  slmulatod  by  unit  symbols  moved  on  a 


iMMUiti,  and  itoUir  faotoro  varies  with  the  ^eoiflo  war  g—aa. 

OPX'a  raqulra  participants  in  tha  field.  Tha  participants 
taka  thalr  poaitiea  at  thalr  approprlata  on— nri  posts,  than  plan 
and  issue  noraal  instructions  tor  tha  oonduot  of  tha  h attla.  Thalr 


plana  art  not  awooutad  by  troopa.  UHplraa  taka  tha  role  of  unita 
and  axaouta  tha  on— nils  on  pper.  Tha  uapiree  ratum  Inf omation 
to  tha  partloipanta  aocording  to  thalr  diagnosis  of  what  would 
hava  happanad  if  tha  ordara  had  baan  aetually  axooutad  by  troopa 
in  tha  fiald. 

Manauvara  raqulra  both  oa— andaro  and  troops  In  tha  fiald, 
Tha  on— nda  ara  executed  by  actual  units,  which  ooonunloata  with 
tha  on— snilar  in  tha  usual  ooabat  fashion.  Uaplrao  ara  utUlmad 
for  casualty  aaaoa— nt  and  for  edtadnlatratlve  dseisiona. 

Manauvara  nay  utlliaa  groupa  as  snail  as  a battalion  or 
as  largo  as  ona  or  nora  field  arnlao.  Thay  nay  be  conducted  by  a 
tsohnloal  oarvloo,  oenbat  any,  or  individual  unit,  or  by  CONAAC. 
khan  nanauvara  of  all  typos  are  oonaldared,  tha  rata  of  oocurranoa 
in  oavaral  par  year.  Tha  prlnary  purpoaa  la  training)  tha  Maneuver 
nay,  of  oouroa,  bring  to  light  inadequacies  in  organisation  or 
aqulp—nt,  hut  this  in  a by-product  of  the  training  aspect.  Naamnn 
involving  vary  large  oc— anda,  such  aa  fiald  arnica,  simulate  per- 
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>.  Tho  flAQMBuaa  itowwr 


8AQURUSH  Involved  two  oppoalng  15-dlvlaion  flald 
m&«.  11m  equivalent  of  about  fim  divisions  uaa  actually 
present)  tha  ranolrrtng  divisions  ware  slwulated  by  special  unplra 


groups*  An  aroa  of  omr  aorao  ninion  aoroo  uaa  occupied  by  tha 
dMMoM  physically  present* 

Tha  troop*  uaro  alaoat  evenly  divided  batman  tho 
*4puaara  a&da  and  t>M  0.  S.  aid*.  Tha  maneuver  uaa  divided 
lata  four  taotloal  phaaaoi  tha  ratrogroda  aorawnt  of  tha  U*  S. 
fiald  arwy,  tha  atatle  phaaa  uhlla  tha  U.  8*  aid*  built  up  lta 
foroaa,  tha  rim  crossing  of  attaokiag  0.  S.  foroaa,  and  tha 
cvar running  of  tha  Aggressor  any  by  tha  U*  8,  any*  Tha  front 
linoo  BOfrod  alaoat  100  a&loo  during  tho  U.  8*  r atrogrado  novowont* 

A nuahor  of  typoa  of  nuolaar  taotloal  uaapona  (alaulatad)  uara 
uaod  by  both  aldoa  during  tha  aansuvor. 

Tha  following  oacoorpt  from  a nawapapar  artlola  gives 
an  indoor  of  tho  raallaa  of  tha  8A0IBRU8H  naneuvsr,  aa  mil  aa  a 
briaf  aeoount  of  tha  aotlon  and  tha  uaa  of  atouio  uaapona. 

Tha  Aggraaaor  ooaaandor  gam  tha  aaln  attaok  Job  to 
tha  ttnd  Alitorna  Division,  Sproad  over  a 17,000-yard  1 no  toad 
of  tha  norual  10,000-yard  front,  tha  oraok  paratroopara  aarohad 
northward  within  nAautao  aftor  Aggraaaor  air  launohad  tha  uar* 
Attaokiag  Onitad  Stataa  roadhlaoka  fron  tha  roar,  thay  Moved 
npldly  forward. 


Tha  Agraaoor  aonwandar  aant  tha  11th  Amorad  Cavalry 
lUglaant  (light  anaor)  agalnat  tha  enwqr's  oaniar  in  a nora 
leisurely  advanoa.  Slwultaneoualy,  a reinfort  *d  infantry 
ragiaant  attaokad  on  tha  right  flank,  following  up  an  Initial 
tflO-an  atonic  cannon  aaaault  on  a oonoontratlon  of  Onitad 
Stataa  troopo  at  a road  natwerk  on  tho  right* 


Tha  l||TiMif  ooHuntar'i  aln  a«Md  to  be  a double 
hi  olnpnend  of  tho  United  Stotoo  3d  Infantry  Division.  Tha 
dofandLna  around  ocMndsr  had  antranahod  in  hiah  good 
north?  thJapoat,  If  tha  Agysaaor  could  oonpreoa  tho 
dofondara  into  a aanll  aroa  bounded  by  lakaa  and  awanya, 
th«y  would  off  or  a food  targot  for  an  atonio  woapon. 

Baanahlle,  tha  Aggreeeor  ooanandar  brought  up  hia 
Fourth  Amored  Division  fron  roaamj  If  an  atonio  blow  waa 
auooaaafal  in  tha  "kill  sons,”  tha  amor  would  bo  a ant  through 
tha  gay  to  oqploit  tho  victory*  Later,  tho  Otnd  and  tha  amor 
would  proaa  forward  rapidly,  porhapo  aidad  by  para  troop  dropo 
to  diaorganiso  tha  dofondara* 

Tho  obrioua  Aggroooor  atratogy  alao  inoludad  boohing 
out  tho  bridgoo  ovar  tho  Sod  River  to  troy  Uni  tod  Statoo 
foreoa  aouth  of  tho  atrooa*  Thay  than  would  have  to  attonyt 
a river  oroaaing  ovar  taayorory  bridgoo  and  would  again  pro- 
aont  a profitabla  atonio  targot* 

Tha  U*  S*  aida'a  obrioua  dafanaa  taetioo  war#  to 
atiok  closely  enough  with  hia  rotroating  infantry  to  tho 
Aggroooor  forooo  to  aroid  heoondng  vulnerable  to  atonio 
attack ) and  by  oountar-attacka  with  hia  Flrot  Arnorod  Dirlsion 
to  oonoontrato  tho  onany  aa  targota  for  hia  77th  Spaeial 
Forooa  OToup,  poaaaaaing  tha  2d0»an,  atonio  cannon,  tho 
Corporal  atonio  guidod  niaallo  and  tha  Honoat  John  rocket. 


Tasting  of  organisation  and  doctrlnso  waa  a major  wlaaian 
of  tha  four  nanauroro  nantionad,  though  not  aa  inportant  aa  training. 
Atonio  oapabilitioo  hara  nsosositatsd  thaoratioal  ohangao  In  tha 
organisation  and  doetrino  of  tho  fiald  way,  and  thoao  ohangao  worn 
too  tad  during  tha  FOLLOW  MB,  BLUBBQLT,  and  SAGEBRUSH  maneuvers. 
Further  thaoratioal  ohangao  ara  alraady  In  aadatanoa  for  future 
fiald  andaaj  it  ia  raasonabla  to  aaauna  that  t hay  alao  will  bs 
tasted  in  nanaurers,  CPX's,  or  war  ganoa  in  tha  n ear  future. 


O 
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Tha  tasting  duties  In  SAOEBRUSH  ware  dirldsd  among 
several  agendas,  all  rasponalbla  to  tha  oantral  taating  ngsntgr, 
tha  Angr  Maneuver  Taating  and  Evaluation  Group.  During  SAGEBRUSH, 
tha  BLO0GLT  and  FOLLOW  NS  svaluatioa  groups  continued  lasts  (bagun  In 
195U)  at  tha  division  lsval.  Tha  AMRO  eonduotad  tasts  at  a flald 
any  laval  and  below  (to  division)  la  addition  to  thoir  nonlnal  ouper- 
vislon  of  all  tasting  aganolas.  Othar  tasting  aganolaa  lncludad  tha 
Gonbat  Oparatlona  Raaaaroh  Group,  Offloa  of  Spselal  Waapons  Develop- 
ment, and  Project  Michigan. 

Oparatlon  SAOIBRUSH  nos  not  originally  plannad  aa  a 
toot  vahlela.  Tha  ANTED  was  not  sstabllsbsd  until  sovaral  months 
altar  tha  pi*»wtmg  for  tha  nanawar  was  started,  and  this  had  tha 
important  offset  of  Uniting  tha  AKTEQ  to  tha  usa  of  taating  tech* 
niquss  which  did  not  require  any  ehangaa  In  operational  plana.  Thus, 
tha  tasting  oontrol  that  oould  ba  imposed  waa  oovaraly  reduced. 

U.  ausMao  Partlolpatlon  In  Manauvar  Teats 

This  dlsousslon  has  bean  narrowed  to  tha  typo  of  laaneo- 
vars  In  idiloh  organisation  and  doctrine  are  materially  o hanged  on  a 
large  seals,  and  In  vhioh  sons  kind  of  empirical  measurement  of  tha 
desirability  of  those  ehangaa  Is  respired.  Tha  history  of  auoh  taste 
le  short  end  HunBRO'o  history  of  partlolpatlon  la  even  shorter.  MunRRO 
voa  requested  to  partlolpato  In  the  FOLLOW  ME  tests,  aa  waa  tha  Opar* 
silane  Raaaaroh  Offloa  (080),  and  both  organisations  assigned  repre- 
aentatlvae  to  the  tasting  group  staff  of  that  manauvar. 
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The  CKO  participation  developed  into  a apaolal  tact  of 
ana  aapaet  of  tha  over-all  FOLLOW  MB  toot,  which  they  designed  and 
ooiwtaotad  primarily  with  thair  on  personnel.  IfanBRO's  participation 
teak  the  fora  of  advloe  for  daaignlng  tha  over-all  tenting  program 
BmdBO'a  advice  naa  praotioal  rather  than  theoretical)  the  administra- 
tive diffieultiaa  were  aooeptad  aa  inherent  in  the  testa.  The  tenting 
situation  was  far  fron  ideal,  and  the  advice  was  United  to  what  could 
be  aoooaplished  under  the  existing  oonditiona. 

ftasao  participated  at  both  tha  BLDEBOLT  and  AMTBQ 
echelona  in  an  advisory  capacity  during  SAOKBRUSH.  The  HumBRO  adviser 
also  served  as  a prinary  source  of  continuity  between  the  FOLLOW  MB 
testing  progran  and  tha  one  developed  by  AMTBQ  for  use  in  SAGEBRUSH. 

The  degree  of  change  in  organisation  and  doctrine  was 
such  greater  In  SAQE8RUSH  in  the  levels  above  division  than  had  been 
tha  case  in  the  BLUEBOLT  and  FOLLOW  ME  divlaion-ais a maneuvers.  Below 
division  level,  fairly  specific  TOAE  changes  were  nade;  above  division 
level,  fairly  large  changes  in  concept  were  made.  One  of  the  prinary 
changes  w»e  the  "splitting  off"  of  tha  logistics  system  from  tha  oper- 
ations system  above  tha  division  level  In  the  atomic  field  smqr.i/ 

In  contrast  to  the  FOLLOW  ME  and  BLUEBOLT  testa,  specif io  reooamsndations 
fer  changes  in  TOME  structure  were  not  required  fron  the  SAGEBRUSH 
maneuver)  tha  raeoanendatlons  fron  that  aansuvsr  ware  to  be  aore  general. 
An  evaluation  of  tha  "separation"  ooneept  r other  than  tha  details  of 
its  lmplaswntation  was  daoired.  This  noant  that  tha  nature  of  tha 
program  would  be  different  fTon  the  FOLLOW  M progran. 
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This  difference  via  not  fully  appreciated  whan  ths 
A1HS0  first  started  its  work,  sad  it  resulted  in  ths  development 
initially  of  s program  that  would  have  colls  c tad  data  too  datailad 
to  bo  of  practical  us  a.  Whan  this  approach  was  soon  to  bo  laprao- 
tiosl,  the  plannara  reverted  to  ths  opposito  aztranoj  they  began 
eonstruetlng  a toot  which  would  produce  highly  abstract  data.  The 
final  test  was  such  that  the  data  collected  were  somewhere  between 
these  two  extrawee.  This  subject  md  the  BueRBO  adviser's  role 
are  dls sussed  in  greater  detail  in  section  III. 

This  is  a brief  history  of  Any  theory  testing  progress 
mad  ths  part  BumBRO  has  played  in  their  development.  Currently  there 
mrm  additional  theories  designed  to  utilise  the  technological  advances 
in  weapons  and  aquipnent  to  greatest  advantage.  Those  theories  are 
dooigmd  in  sufficient  detail  to  reorganise  the  Arwy.  As  the  "hardware" 
an  which  they  are  based  cones  into  production,  new  Amy  organisations 
and  doctrines  will  probably  be  tested  and/or  adopted. 

BmBBO  has  reooonsnded,  in  the  BoeRRO  Annex  to  the  AMTBQ 
report,)/  that  future  testing  effort  bo  focused  on  controlling  con- 
tent nation  factors  by  manipulation  of  the  maneuver  oonditlons,  rather 
than  on  further  refinement  of  the  present  testis  techniques,  BusRBO 
has  farther  reoorom ended  that,  in  order  to  eoonryllsh  this,  a testily 
agency  be  established  several  nonthe  before  the  operational  pi»m><wg 
far  ths  maneuver  begins,  at  OOHARC  or  Department  of  tbs  Amy  level. 

This  sill  allow  the  testing  group  time  to  make  plans  and  recowmend 

■answer  conditions  suitable  to  ths  tasting  program  adopted. 

XT"  Uporl  o3P  Any  Tests,'  Kxardae  SMSBHUJU  (CtJWiliJSNTlAL.  TCCIFTKD 

HUDUno).  Jtth  Amy  Brndquartem,  February  1956 • 
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D.  Tin  SA01BBU3H  Tasting  Proarm 
1.  Tin  Testing  Organisation 

Tin  SAGEBRUSH  maneuver  ms  originally  designed  to  train 
troops  in  the  now  ATFA  organisation  and  doctrine.  Several  months  after 
the  planning  for  the  Maneuver  was  initiated,  it  was  decided  also  to 
test  the  ATFA  concepts  during  the  asneuver.  A t eating  agency  (AMTEQ) 
was  established.  It  consisted  of  about  20  officers,  primarily  majors 
and  lieutenant  colonels,  and  one  civilian  scientific  adviser  from 
BusRROj  the  chief  of  the  group  was  a colonel.  This  group  win  be 
referred  to  hereafter  as  the  nucleus  group.  The  AMTEQ  was  concerned 
with  testing  the  ATFA  concepts  at  anqr,  corps,  and  division  level. 

Two  major  subsidiary  testing  groups,  which  had  been  in 
sodstenee  the  previous  year  during  the  FOLLOW  ME  and  BLDEBOLT  division, 
aimed  testa,  tested  the  infantry  and  armored  divisions. 

Shortly  before  the  asneuver  took  place  a new  chief  and 
deputy  chief  were  appointed,  a brigadier  general  and  a colonel. 

Shortly  after  these  changes  the  nucleus  group  was  augmented  by  about 
80  officers,  primarily  lieutenant  oolonels  and  colonels,  who  functioned 
as  field  evaluators.  After  the  maneuver  the  group  was  reduced  to 
about  25  officers,  most  of  whoa  had  been  in  the  original  nucleus 
group.  The  additional  officers  were  of  higher  rank  than  those  of  the 
original  group  and  were  named  as  the  responsible  officers  in  preparing 
the  report  of  the  test.  When  the  final  report  was  finished,  two  months 
after  the  meneuver,  the  AMTEQ  was  disbanded.  The  report  was  submitted 
to  OOHARC  with  copies  to  the  various  Amy  schools  and  HumRRO  for  eommen 
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2.  The  ATFA  Conospta 

The  ATTA  ooneepta  have  never  been  defined  exactly. 

Many  ooneepta  were  tried  for  the  first  time  during  SAGEBRUSH;  moot 
of  them  ware  advanced  as  "desirable"  in  atoaio  war  and  thue  oate- 
goriaed  aa  "ATTA".  It  wea  the  reeponeibllity  of  AMXEQ  to  teet  all 
new  ooneepta,  but  acme  of  the  ooneepta  applied  to  the  present 
a tender  type  army  aa  well  as  the  ATFA  army.  Tor  instance,  the 
aocelarated  deta-proeeesing  concept  (introduced  by  Project  Michigan), 
the  integrated  intelligence  system,  and  the  Signal  Corps  grid 
o o— injections  system  apply  equally  well  to  the  ATFA  and  to  s tandard 
armiea.  Concepts  that  did  not  apply  to  the  standard  army  were  the 
support  coianrt  (a  specialised  logistics  concept),  the  tactical 
"Islands  of  Defense,"  and,  to  a certain  extent,  the  extended  ground 
reoonnalssanee  concept. 

The  AMTEO  was  not  primarily  concerned  with  t eating  the 
tactical  concepts.  The  principal  concern  of  its  testing  program 
was  the  support  oommand  concept.  This  is  generally  the  concept  to 
which  the  term  ATFA  refers,  although  any  or  all  of  the  other  concepts 
tested  during  SAGEBRUSH  may  he  included  in  a loose  sense.  (The 
AMTEO  at  one  time  planned  to  prepare  more  exact  definitions  of  what 
constituted  "ATFA",  but  decided  against  this  action  when  differences 
of  opinion  developed  regarding  what  "ATFA"  was  and  wiwt  it  was  not. 
Since  the  AMTEO' a mission  waa  to  test  ell  new  concept? . It  was  not 
crucial  for  them  to  make  the  distinctions  for  their  report. ) 
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Ths  purpose  of  the  support  oo—and  concept  Is  to 
rollors  thstscticsl  oca— ad—  of  tho  logistical  load,  and  also  to 
facilitate  the  flow  of  supplies  by  establishing  a specialised  branch 
for  this  purpose.  The  oonoept  of  specialisation  for  this  function 
is  not  entirely  newj  it  exists  to  so—  extent  in  the  standard  angr, 
although  it  is  not  ae  fornal  or  elaborate  as  in  the  ATFA  artsy. 

In  the  ATFA  any  a general  officer  is  in  eo— and  of 
a logistics  organisation  responsible  to  hln  aether  than  to  tactical 
ooa—ndere  at  various  echelons ; ell  oo— s art  that  tactical  commanders 


below  the  any  level  exercised  over  logistical  natters  in  the  standard 
anqr  is  severed.  The  support  ooanand  oo— nnder  is  responsible  to 
the  any  (tactical)  oo— ander,  but  not  to  any  of  the  latter's  sub. 
ordinates.  In  the  ATFA  any*  all  oo— and  previously  exercised  by 
teotioal  oomandars  over  their  support  takes  the  fore  of  requests. 

This  ATFA  oonoept  is  designed  to  o reate  a greater  flexibility  as  well 
as  to  provide  other  advantages.  The  flexibility  is  present  in  the 
sense  that  the  centralised  support  of  the  logistics  ooa— nd  nay  be 
dir  eo  ted  toward  the  teotioal  unit  in  greatest  need  of  support. 

The  opposite  extra—  1s  for  oaeh  tactical  unit  to  have 
its  cam  support.  This  typo  of  organisation  is  inflexible,  in  that 
support  cannot  asslly  bo  shifted  to  ths  aost  needy  teetloal  unit. 

The  support  ooraand  oonoept  is  similar  to  ths  artillery  oonoept. 


according  to  which  all  ths  oentralised  artillery  support  can  be 
shifted  to  ths  aost  neety  unit. 


not*  strictly  spooking,  • BmRBO  activity  in  that  It  saa  no1 
*aa  of  olthar  training  or  activation,  aorala,  mm!  load*  rah  ip 
HiaRBD  soloist  lots  often  oonotruet  oritarlon  situations  an 


shlsh  to  tost  an  rap  or  Inant  al  program  of  Instruction  against  tbs 
standard  program*  Slnos  ths  objective  of  ths  Any  tasting  groups  sai 
to  oonotroet  tho  maneuver  In  a Aim  that  scold  "tost"  tho  ATM  flold 


any  against  ths  standard  flold  any,  HnBBO  oolontlsts  vara  presumably 
In  a position  to  oontrltato  axporlsnoe  and  adrios  to  ths  tooting 


faalliar,  and  to  outline  the  direction  which  the  large-scale  testing 
effort  nust  take  If  it  la  to  provide  predictions  better  than  the 
laplioit  eetlnatee  of  experienced  iisgr  officers. 

Gliding  a large-scale  "test  criterion"  fbr  teetlng  a field 
angr  is  of  course  very  different  from  building  a "teat  criterion"  for 
an  Infantry  squad  in  tbs  night  tine  defense.  One  Implication  of  this 
difference  In  soope,  which  should  be  carefully  noted,  la  that  In  the 
wall  sosle  situation  the  civilian  scientist  can  absorb  enough  ailltary 
lnfbmatlon  to  beoone  an  "expert"  in  the  snail  area  on  which  he  Is 
concentrating.  He  can  thus  use  a certain  anount  of  laplioit  skill  In 
abstracting  the  pertinent  features  of  the  situation  which  should  be 
Included  In  the  criterion  test. 

The  civilian  scientist  Is  not  likely  to  absorb  enough  of 
the  situation  in  which  a field  a my  operates  to  use  the  sane  laplioit 
proosss  of  abstracting  the  important  features  for  building  a large 
seals  criterion  test. 

2.  Methodology  for  the  Abstractive  Process 

Behavioral  scientists  do  not  have  a formal  Methodology  fbr 
abstracting  the  laportant  features  of  a job  or  task  for  Inclusion  In  a 
training  or  selection  program.  Such  solsntlsts  have  for  years  used 
various  abstractive  processes  such  as  task  analysis,  aotivlty  analysis, 
and  ltan  development,  and  on  an  intuitive,  artistic  basis  they  probably 
have  sons  skill  In  this  activity.  However,  the  foraal  ns  tbo  do  logy  for 
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The  prooMi  la  the  sane  as  that  involved  In  "transfer  of 
training."  Tha  problem  la  ona  of  aalaotlng  tha  anallest  rwbar  of 
ooaaon  eleaants  bataaan  tha  criterion  and  training  aituatlona  that  give 
tha  graataat  aoouracy  of  predicting  tha  aoooapllahaant  of  ona  froa  tha 
othar.  (Tha  sane  abstractive  prooaea  applies  to  tha  aalaotlon  area, 
but  tha  maaber  of  alaaanta  la  generally  aaallor  and  tha  elsnents 
theas elves  simpler  or  nore  baa In.) 

It  oan  thus  ba  aaan  that  tha  HumRRO  adviser  oould  advise 
on  an  "artlatio*  baa  is  only.  No  formal  msthodology  ax  la  tad  for  pra- 
aorlblng  tha  level  of  abstraction  to  ba  uaad  In  dsaljplng  tha  toot 
orltarlon,  nor  vara  any  techniques  available  for  abetraoting  tha  noat 
laportant  feature  froa  either  the  ooabat  or  aansuvsr  aituatlona. 
Although  advioa  regarding  both  theee  aubjeota  vaa  given  and  uaad,  it  la 
tha  thoala  of  thla  paper  that  oontlnued  advloa  on  thia  artlatio  level 
will  not  contribute  greatly  to  future  Army  teata  of  tha  type  described 
hare.  Rather,  it  la  hold  that  if  the  oontrlbutlona  of  behavioral 
eo lent lata  era  to  have  value,  tha  prooeaa  of  abetraoting  laportant 
fbaturao  (laolating  variables)  auat  be  attacked  directly. 

Many  Aray  officers  have  advanced  an  alternative  solution 
to  the  problan  of  task  analyslai  They  suggest  that  offioere  ba  sent  to 
school  for  a year  or  too  In  order  to  equip  then  with  the  skills  for 
■eking  aueh  analyaeo.  Slnoa  tha  problan  of  teak  analysis  la  so  central 
to  thla  paper  further  examination  of  thla  proposal  is  appropriate. 


The  parts  of  tit#  oollsgs  curriouluu  for  solsntlfle 


specialists  srs  closely  lntsrrslatsd  and  interdependent;  oonplstlon 
of  tits  whole  ourrleulun  would  bo  necessary  bofbrs  tho  off  ere  would 
boss  tho  background  they  would  need  in  ordor  to  attack  thoir  particular 
problana.  On  tho  other  hand,  it  is  pooalblo  for  tho  Aruy  to  bring 
oollofo  profeaaora  to  tho  spoeifio  situation  voider  oonaidoration.  Tho 
adrlos  tho  professor  would  give  in  this  situation  aay  bo  oonsldared  as 
tho  boot  lecture  ho  oan  del  Ivor  on  this  specific  subject)  as  ho  learned 
■ore  of  tho  situation  his  "lecture#*  would  bo cone  wore  Incisive.  This 
soons  wore  feasible  than  sanding  tho  officer  to  eollegs,  whore  his 
specific  problan  will  not  bo  dealt  with. 

It  soaus  fairly  oertaln  that  the  large-scale  Arny  testing 
pro  gnu,  unlike  tho  anaall-eoale  test,  cannot  bo  handled  by  the  civilian 
scientist,  beoauso  ho  cannot  analyse  tho  field  arny  In  a few  aonthe 
with  his  present  knowledge  or  tools.  Since  he  cannot  provide  an  answer 
in  the  fora  of  an  analysis  of  test  criterion,  sone  other  solution  ne^ds 
to  b#  devised.  More  tlae  and  effort  with  the  present  approach  is 
raooraendad  by  the  writer. 

3o  Iaplioetlone  for  HuaHHO 

The  iaplicetlon  of  this  problen  for  HunRRO  is  that  civilian 
scientists  srs  not  frail  tar  enough  with  large-Boale  Any  operations  to 
glow  appropriate  advice  for  tho  construction  of  large-aoale  test-criterion 
situations  without  full -tine  attention  to  ths  ptroblea.  Continuous  contact 


with  such  operations  would  be  needed  eo  that  scientists  could  either 
learn  enough  to  isolate  the  pertinent  features  for  inclusion  in  a 
criterion  test  situation  or  develop  more  formal  procedures  through  which 
A mgr  officers  oould  do  this* 

In  the  opinion  of  the  writer  (and  most  Army  officers) 
civilian  scientists  osnnot  learn  all  there  is  to  know  about  field  any 
operations,  end  it  seme  reasonable  to  assume  that  a pieoaaeal  effort 
in  the  large-scale  testing  area  cannot  produoe  important  improvements 
in  testing  programs.  If  this  is  true,  only  marginal  improvements  can 
accrue  from  HwRRO's  efforts.  Such  activity  reinforces  the  stereotype 
of  the  scientist  as  a person  cones  mod  with  unimportant  details,  and 
the  scientists  Involved  likewise  feel  they  are  not  working  to  good  offset. 
This  memorandum  indicates  the  complexity  of  e large-scale  testing  program, 
end  it  is  Intended  to  serve  as  supportive  evidence  for  the  view  that  the 
problem  cannot  be  effectively  solved  with  a email,  piecemeal  effort. 
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A*  Ohana—  in  Anr  Doctrine  and  Or— nlsation 

Fop  the  first  tl—  In  —arioso  history,  taohnologloal  ad— no— 
in  — pona  and  eqnlp— nt  ha—  baan  continuing  at  an  aooelentad  rata 
aftar  a— tlon  of  actual  war.  Often  the  now  da— lop—nte  ao  greatly 
inpro—  Military  capabilities  that  adoption  of  now  organisations  and 
doctrine  in  order  to  utilise  then  is  lnouabent  on  the  Any.  The  ATFA 
oonoapto  represented  one  of  thoeo  r— tructuringa  In  organisation  and 
doctrine*  Other  changes  are  in  the  planning  stage  and  appear  likely 
to  continue  far  Into  the  future. 

The  nature  of  the  alterations  that  should  bo  node  is  not 
obvloue.  The  Any  auat  giro  up  oartaln  advantages  for  others  when  theee 
chang—  are  —da,  and  whether  the  ad—ntag—  given  up  are  greater  or 
la— or  than  the  ad—ntag—  gained  la  a — ttar  of  Judgment  in  —oh  oa sco 
Generally  the—  is  — quantification  of  the  various  outputs  of  the  field 
any,  — the—  Judge— ta  aue t be  —da  through  *»at  — nay  call  the 
artistic  skill  of  aspari— d officers.  It  oa— a re— enable  to  — sum 
that  the  chang—  in  Aseqr  oonoapta  will  be  of  considerable  Magnitude  in 
a fbw  yean)  — the  new  weapons  and  equips— t — d thair  new  supportive 
organiMtio—  and  doetrln—  in  ora— a,  the  Any  beooa— , of  ooureo,  1— a 
and  1— a the  Any  with  whloh  axperl— oe  d off  loan  an  1—11  iar.  The 
qu— tlon  of  how  far  into  ths  future  axpari—oad  offloan  oan  extrapolate 
— the  b— la  of  thair  expert— oa  fr—  19U5  and  1952  should  be  oons  idand 
now. 
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Sinoe  1%  la  aw  of  the  Mjor  oonoerne  of  aolanoe,  tho  pnblai 
of  extrapolation  auggeata  a aolanilflo  approaoh.  Thora  ora  no  a priori 
grounde  tor  bailor lng  that  tha  Arqy  situation  la  ao  unuaual  that  it  would 
not  ba  ananabla  to  < aolantlflo  approaoh  of  isolating,  quantifying, 
minting,  and  extrapolating.  Tha  only  Iwnert lately  apparont  objection  to 
aueh  an  approaoh  ia  tradition— -that  tha  oortrapolatlona  ham  always  boon 
on  an  artlatlo  baaia  and  tharofbra  they  nuat  bo  artiatlo  in  nature. 

Vo  canine  tha  narlta  of  thia  objection,  lot  ua  oonaldor  a 
altuation  In  which  thia  rlaw  previously  pram  Hod.  by  aoloetlng  an  axaaple 
wham  wo  ham  tho  admntaga  of  tha  para poot lro  that  oonaa  with  hlndalght 
wa  oan  Judge  tha  proa ant  oaaa*  Karly  pilota  laanaad  to  fly  without 
lnatruaanto— ' "by  tho  aaat  of  thalr  panto,"  ao  to  apaak.  Whan  aiapla 
lnatrunonta  warn  lntroduoad  In  latar  aircraft  older  pilota  often 
ridiculed  theee  inatnsasnte  and  tha  younger  pilota  who  uaed  thonj  tha 
older  pilota  generally  oould  fly  tho  now  aircraft  "by  tha  aaat  of  thalr 
panto"  batter  than  tha  younger  pilota  could  with  tha  crude  Instruments. 

Thia  waa  an  lnotanoo  of  fbmal  quant  if  loot  Ion  of  a altuation  by  uee  of 
quantifying  lnatrunonta.  Tha  analyela  of  tha  altuation  needed  tor  flying 
tha  alreraft  oould  ba  node  by  tha  uae  of  lnatrvnenta  or  by  an  artlatlo 
analyela  of  undefined  ouao  aueh  aa  how  hard  tha  wind  blow  on  tha  pilota 
faaa.  Wa  know  that  either  procedure  "worked,"  with  tha  admntaga  going 
to  tha  "aaat  of  tha  panto"  pilot  for  acne  tine.  Qmdually  tha  lnatrunanta 
baaena  bettor  and  tha  a lro  raft  grow  ao  oonplax  that  tha  pilot  oould  no 
longer  get  enough  Information  from  the  "aaat  of  hla  panto"  to  fly  it. 


Wo  now  hove  the  advantage  of  perepeotlve  in  Judging  thio 
dlfforoooo  in  flying  technique.  Wo  know  that  Sn  tho  Halted  front  of 
refUrenoe  of  the  oiroroft  of  hit  day,  the  older  pilot  woo  oorreotr 
Bat  wo  oloo  know  that  them  In  no  queatlon  about  tho  noooooltgr  far 
lnotrunont  flying  in  prooent-dgy  oiroroft.  In  thio  oonoo  tho  oldor 
pilot  woo  oonpletely  wrong.  So  it  Mgr  bo  with  preeent-doy  teohno- 
logiool  amino. 

In  noot  oituotiono  portinont  footuroo  oan  bo  abetreoted  and 
wood  to  prodiot  tho  whole  oituotion.  Thio  in  tho  prooooo  of  inolotiag 
variables  (or  "min  effecte",  in  tho  analyale-of>varlanoo  porlonoo)  and 
tooting  thaw  for  general  applicability*  Atteapto  to  inolate  tot ia blew 
in  tho  now  Arogr  oitaation  oannot  bo  expeoted  to  yield  aetoniohing  find* 
lngn  tw  tone  tine.  Juet  an — ibr  a tine — the  older  pilot  oould  d»  a 
bettor  Job  than  tho  yovng  Inotranmit  flyer , the  nllitaiy  expert  oan  <k> 
a batter  Job,  leplioitly,  than  oan  the  flrot  a tape  of  an  leoletlng, 
quantifying  progran.  It  in  in  fact  an  indication  of  validity  when 
initial  aolmtiflo  approaohoo  yield  the  atom  one  were  aa  experienced 
ailitary  judyeoat  Juot  an  It  woo  whan  the  inotruwentn  beoane  good 
enough  to  give  tho  pilot  the  tone  infomation  ho  woo  able  to  get 
previously  ty  an  art  lotto  analyoia  of  tho  eltuatlon. 

B.  Wty  a Toot  lo  Dooirod 

Tho  average  Any  offioer’o  oonoeptlon  of  Co*  e'oianiirio  o*V>od 
in  probably  onNoriood  in  tho  word  "toot."  Teoto  ore  generally  wood  to 
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obtain  information  (at  a givan  confidence  laral)  regarding  tba 
daa Inability  of  altoroatlTas)  on  the  average,  more  oonfldenoa  can  bo 
plaood  in  the  reeulte  of  an  empirical  teat  than  In  the  results  of 
artistic,  non-empirloal  analyses*  Since  the  results  of  tests  have  the 
reputation  of  being  correct  In  scientific  circles,  the  Any  often 
desires  test  results  for  their  problau  of  restructuring* 

C*  Pitfalls  for  the  layman 

Unfortunately  the  statements  In  the  preceding  paragraph  are 
only  generalisations  that  might  be  appropriate  for  the  layman  audience) 
the  solantiat  knows  that  they  are  not  true  in  all  oases*  "Tests"  are 
not  always  used  as  a means  of  obtaining  information)  sometimes  they  are 
used  as  a device  for  oonvlnolng  others  (toothpaste  ads  are  an  extreme 
exa^ile  of  this).  And  If  a test  cannot  be  adequately  controlled,  it 
will  not  produce  any  better  information  than  can  be  obtained  through  a 
non-empirloal  analysis*  In  fact,  any  test  can  be  "rigged"  by  selection 
of  inappropriate  criteria*  The  layman  Is  thus  in  a difficult  position) 

I 1 

he  knows  that  tests  are  "good,"  but  he  cannot  diatinguiah  the  conditions 

8 a 

that  produce  valid  data  from  those  that  do  not*  The  scientist  is  not 
infallible  in  making  these  discriminations  either,  but  he  has  some  skill 
in  tbs  process  and  knows  soma  wsak  spots  to  look  for* 

D*  The  Army  Dllamma 

Sinoe  they  are  not  trained  in  the  scientific  discipline.  Army 
officers  must  be  considered  laymen  in  the  matter  of  empirical  tests* 

The  attitude  they  may  be  expected  to  maintain  la  that  of  any  sophisticated 


u 


22 


o 


Up n that  tarts  oan  produce  brttar  Information  than  non  naplrloal 
analyses*  but  anlaas  tbs  food  tsst  oan  ba  distinguished  fron  tbs  poor* 
too  nueh  oonfldsnes  Mgr  ba  plaosd  In  the  wrong  results. 

The  Arny  oould  do  tbs  tests  Itself  so  that  It  would  know  how 
to  evaluate  the  results  or  It  oould  allow  civilian  scientists  to  nake 
tha  teats*  There  are  real  dangers  In  both  of  these  approaches*  The 
civilian  scientist  does  not  know  enough  about  tha  over-all  subject  of 
Axegr  warfare  to  ensure  the  proper  construction  of  test  criteria  for 
large -scale  tests*  This  la  likely  to  produoa  biased  conclusions  to 
which  an  inordinate  weight  night  be  attaohad  by  tha  Any  because  tha 
results  are  derived  fires  "tests."  On  tha  other  hand*  teats  conducted 
ty  unitary  personnel  only  axe  not  apt  to  be  incisive.  The  abstractive 
prooess  of  selecting  the  SMllaet  aunber  of  slsnente  needed  for  aoourmte 
prediction  Is  a crucial  one  in  producing  workable*  valid  teste*  This 
skill  Is  part  of  the  general  scientific  Method  and  is  no  re  likely  to  be 
exploited  by  sclantlata  than  by  Any  officers* 

Bo  A Poeslhle  Solution 

The  fuailiar  process  of  scientific  validation  appears  to  bo  a 
solution  to  the  problem*  The  validating  criterion  In  this  case  would 
not  be  actual  ooabat  but  a "tsst  criterion"  which  would  represent 
ooabat  (as  described  In  section  IV)*  Ifer  Maintaining  control  over  the 
slsnente  In  s test  criterion,  A rey  personnel  oould  assure  tests  that 
warn  not  biased  because  of  the  inexperience  of  civilian  scientists  In 
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the  subject  of  Any  warfare.  The  scientific  prooess  oould  continue  with 
the  production  of  expert nant el  test  situations*  and  the  criteria  of  these 


would  beocme  wore  and  more  abstract  from  the  toot  criterion.  This 
proooao  of  abstract Ion  would  involve  tha  Isolation,  quantification, 
relation,  and  extrapolation  necessary  for  incisive,  usable  scisntifie 
predictions.  But  eradiations  would  all  have  to  be  validated  against 
this  "test  criterion"  at  intervals.  Any  failure  of  the  super lnental 
situations  to  predict  the  "test  criterion"  would  indicate  that  some- 
thing was  wrong. 

Of  course,  the  abstractive  procesa  would  not  "belong"  to  the 
scientist!  it  could  be  accomplished  only  by  teams  of  military  men  and 
scientists  working  together.  The  iiqportant  point  is  that  by  the 
technique  of  maintaining  "test  criterion"  situations  the  Any  can  ensure 
against  results  biased  by  oivilian  scientists*  inexperience,  and  at  the 
sane  time  obtain  the  benefits  of  a scientific  approach. 
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ni.  Scientific  Advioe  Purina  ttx  SAGEBRUSH  Itoiuwr 

A.  An  Application  of  the  Scientific  Method  In  SAQSBRUSU 
X*  Advloo  Regarding  Level  of  Abstraction 

After  the  general  dlsousslon  of  the  need  for  • scientific 
approach  through  the  abstractive  prooeaa,  it  may  be  desirable  to  provide 
an  example  of  how  advloe  of  this  type  was  offered  to  the  AMT8Q  during 
SAGEBRUSH.  This  example  will  also  serve  as  a referent  for  the  wore 
detailed  analysis  of  the  test  criterion  development,  which  will  follow 
In  the  next  section* 

As  mentioned  previously,  SAGEBRUSH  was  planned  as  a train- 
ing maneuver  only)  the  AMTBO  had  almost  no  oontrol  over  the  establishment 
of  the  maneuver  conditions.  When  the  AMTBO  was  established  it  ooneisted 
of  only  a few  officers  with  no  specific  plans  for  conducting  a test  of 
the  ATFA  field  a ray. 

The  Anna's  initial  approach  was  to  ask  the  various 
teohnioel  schools  and  oombat  anas  sehoola  to  submit  requirements  for  the 
test.  The  requirements  obtained  ty  this  procedure  were  generally  in  the 
form  of  questions,  of  the  type  that  the  Any  use*  in  unit  proficiency 
tests.  It  was  only  natural  that  such  questions  would  be  submitted, 
beoause  the  Amy  conducts  this  type  of  test  every  day  of  the  year. 
However,  the  scope  of  the  SAdhBRUSH  test  was  much  larger  than  aiy  tests 
of  a unit's  proficiency)  its  concern  was  not  proficiency  within  a unit 
but  hew  well  the  unite  worked  together.  For  instance,  the  concern  was 
not  with  the  tasks  connected  with  vehicle  maintenance,  auoh  as  "cheek  oil 
level,"  "tighten  bolts,"  or  "adjust  cable,"  but  with  the  output  of  the 
maintenance  system,  "how  msny  vehicles  were  fixed  each  <Uy." 


Tha  unit  proficiency  approach  waa  not  wrong  on  theoretical 


(round* | In  theory,  the  detailed  quaatlona  could  be  arranged  to  "add  upH 
to  the  larger  queetione.  If  enough  people  had  been  available  to  go  out 
and  maaaurs  the  detail*  of  perfbmanoe  within  each  unit  the  approach 
would  have  been  appropriate,  and  auch  information  would  have  been  wore 
"factual,"  leea  open  to  diffbrenoe  of  opinion.  On  a field-army  eoale, 
however,  thl*  kind  of  approach  would  have  required  thouaanda  of  obeervere. 
The  HumRRO  adviser  therefore  advised  against  it  and  reoowsndad  that  a 
■ore  abe tract  unit  of  maaauramant  be  used.  Here  it  is  important  to 
rvMnber  that  explicit  advice  regarding  a more  deairable  level  could  not 
be  giwi  by  a civilian  ac lent  1st  without  an  extremely  detailed  An*T 
background  or  any  formal  methods  that  were  suitable  for  analysing  the 
task  at  hand.  The  adviser  could  only  suggest  a more  abstract  level  and 
examine  the  product  of  the  Anqr  officers'  implementation. 

The  AMTEO'S  next  ehoiee  of  abstractive  level  fbr  measurement 
involved  only  five  categories — mobility,  flexibility,  invulnerability, 
oommand  control,  and  fire  power— Instead  of  the  thousands  of  categories 
of  the  unit  proficiency  checks.  The  approach  at  this  level  of  abstraction 
wee  almost  decided  on  for  the  final  units  of  measurement!  however,  some 
officer*  of  the  nucleus  group  of  AMTBQ  found  that  they  had  difficult  in 
mi  awering  the  questions  they  themselves  wrote  in  theee  abetraot  terms. 

The  problem  was  discussed  with  the  HumRRO  scientific  adviser.  He  advised 
against  the  use  of  categories  at  auoh  a high  level  of  abstraction  haosnaa 
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tb—  wtabl«  ted  no  ueablo  definitions,  operational  or  othonrloo. 

Tte  idrter  Mt  ttet  tho  uoo  of  onoh  undefined  variables  would  rooult 
in  a mm  of  indlTldonl  interpretations  by  flold  oboorroro  ttet  would 
not  "add  te"  to  anything. 

Tte  decision  was  nada  to  try  anotter  level  of  atetiaetlon 
aoMMtera  between  tte  two  njeoted  levels.  Tte  third  larval,  finally 
uaad,  waa  generally  referred  to  aa  a r/at—  approach  rathar  than  a unit 
approach,  to  distinguish  it  fro*  tte  volt  proficiency  approach*  "System" 
referred  roughly  to  an  organlMtlon  of  tha  type  of  tte  Signal  Corpa  or 
Onbianoa  Corpa,  with  a function  Independent  of  other  systems  ratter  thi) 
to  battalloon,  nonpanlaa,  oto*  Tte  Mlt  of  aeaeureaant  In  this  approach 
mm  in  tana  of  tha  Mjor  output  of  aanh  of  tte  systems.  An  output  waa 
oonslderad  major  If  it  want  to  a unit  otter  than  tha  ona  which  produced 
it.  Tte  outputs  which  ware  directed  wholly  against  tte  anas y ware  not 
gene  rally  measured,  for  certain  administrative  reasons  which  will  be 
dlseuseed  later. 

The  outputs  and  Inputs  In  this  approach  wen  celled 
"packages.”  The/  wen  quantised  by  tte  Joint  conditions  of  who  produced 
then  end  who  ooneunod  thna.  The  ten  "package"  referred  to  services 
(eueh  as  nalntenanoe)  ee  well  ae  to  concrete  Items.  A package  waa  not 
dependant  an  else  or  aontent— that  In,  amount  or  type  of  output.  Nor 
did  it  depend  exclusively  on  either  tte  producer  or  consumer,  but 
Jointly  on  both. 
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2.  How  the  Dependant  Variables  Were  Measured 
•o  Adequacy  of  the  package 

Measuring  tlw  paekagsa  required  * judgment  by  the 
evaluating  officers.  If  tlw  Judgment  had  baan  made  at  a lower  abstrac- 
tive level  (e.g.,  cll-geuge  level)  it  would  hart  baan  eonaldarad  highly 
reliable— a "fact."  If  It  had  baan  at  a higher  level  (e.g.,  nobility ) 

It  would  haua  baan  highly  speculative,  because  of  the  ambiguity  of  the 
category.  At  the  paokaga  level  It  waa  a on  ■where  between  theca  aoctxenee. 

The  neaaurenant  of  the  paokagee  waa  in  groaa  tame, 
beoauae  with  the  other  large  aouroee  of  error  in  the  teetlng  pragma  it 
waa  not  eoononieal  to  attcapt  fine  dlaerlalnatlona  In  judgpent.  The 
packagee  were  judged  In  three  dagmas—adaquats,  Inadequate,  or  aarginal 
with  reapect  to  the  lnputa  and  outputs  of  corresponding  system  in  the 
standard  aray* 

b.  Techniques  fbr  partialing  out  confounding  fhetora 
One  of  the  biggest  problana  confronting  the  AMRO  waa 
the  prasenoe  of  oontaalnatlng  factors. The  Independent  variable  to  be 
investigated  waa  the  field  any  organisation  and  doctrine,  and  the  de- 
pendent variable  was  the  ability  of  the  various  oowponent  systems  in  the 
ATM  field  any  to  produce  outputs  that  were  as  adequate  as  those  of  the 
standard  field  any.  The  dependent  variable  was  of  oourse  a function  of 
nswrous  factors  besides  those  under  investigation,  such  as  profloiancy  of 

\/  A ampliation  of  those  factors  prepared  by  the  AMTBO  my  be  ftnnd 
in  Appendix  B. 
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MR  and  units,  adequacy  of  equipwant,  s online  down  of  fureM,  and 
quality  of  unplrlng.  Under  tha  asneuver  oondltlona  tbaaa  Important 
tnriabiae  vara  allovod  to  vary  in  a randan  fashion  with  raapoot  to  tha 
oontrol  group,  tha  standard  flsld  anqr. 

Slnoa  it  was  not  adalnlstratlvely  foaaibla  to  oontrol 
thaaa  oontaminating  factors  by  boldine  than  oonatant,  tha  HtvRRO  adviser 
raooanandsd  an  alternative  technique  fbr  oontrol— a technique  designed  to 
•partial  out*  tha  offset  of  tha  unoontrollsd  motors  through  tha  judpasnt 
of  tha  observers  of  tha  action.  This  aothod  was  adopted  for  via  In  tha 
SAGKBRDSH  toots. 

Tha  parsons  who  partlalod  out  tha  offset  of  the  oontsvi- 
natlnc  factors  wars  senior  off! oars  (eajor  to  oolonal)  oallad  evaluators. 
The  oral ua tore  aat lasted  what  tha  Talus  of  tha  dependant  variable  would 
have  bean  if  such  factors  as  profioianqy  and  oqulpsisnt  had  bean  tha  sane 
aa  In  a standard  unit  operating  under  tha  sane  oondltlona . After  asking 
this  Judy  ant,  tha  evaluators  ware  required  to  aaka  an  additional  deter- 
mination aa  to  whether  this  adjusted  value  of  tha  dependant  variable  waa 
adequate,  inadequate,  or  aarglnal  with  respect  to  a corresponding  standard 
unit. 

It  waa  recognised  that  the  "part lolling  out*  toohnlquo 
wads  tha  data  even  wore  subject  to  personal  factors  and  thus  leaa  reliable, 
■ovever,  tha  alternative— accepting  the  dependant  variable  aa  a represen- 
tation of  only  organisation  and  doctrine  dlls  such  Important  factors  aa 
proficiency  and  oqulpnent  warn  ignored — was  certain  to  produce  erroneous 
oondaelons.  Losing  reliability  waa  felt  to  be  less  undesirable  than 


accepting  a datua  known  to  b«  in correct.  Only  the  most  experienced 
officers  served  aa  evaluators,  and  they  only  after  a day  of  Instruction 
in  the  use  of  the  method.^/ 

3o  Other  Heaaurlng  Teohniquae 

In  addition  to  the  evaluative  technique  two  others  were  used. 
One  wes  the  comparative  technique.  In  which  there  wae  no  requirement  to 
partial  out  the  influence  of  oontanlnatlng  factors.  The  officers  who  used 
this  technique  were  required  only  to  coapare  the  adequacy  of  the  actual 
performances  with  those  of  standard  unite  in  similar  situations  in  combat. 
Thsse  officers  were  generally  participants  in  the  maneuver  and  received 
no  special  "schooling."  They  were  sent  questions  on  vari.us  aspects  of 
the  situation  about  which  they  were  expected  to  be  Informed,  and  were 
furnished  a page  of  Instructions  for  making  their  Judgments* 

The  third  technique  was  a straightforward  one  of  recording 
euoh  data  as  times,  frequencies,  and  temperatures c No  special  group  vaa 
ast  up  to  provide  this  information}  it  waa  obtained  primarily  from  standard 
formal  reports  and  journals  developed  In  the  nornal  course  of  maneuver 
operations. 

ho  Relationship  qf  the  Various  Measuring  Techniques 

It  should  be  noted  that  even  the  more  "factual0  of  the  three 
techniques  did  not  provide  a check  on  the  more  unreliable  techniques. 

For  Instance,  if  an  evaluator  judged  a certain  performance  "adequate"  and 
a comparative  judge  judged  the  earns  one  inadequate  both  judgments  bad  to 

1/  This  instruction  was  provided  by  the  HtaaRRO  adviser. 

(See  Appendix  C.) 


be  eooepted  as  oomoti  Jn  making  hl«  judgwni,  the  evaluator  Mgr  have 
considered  the  actual  perfbxM mce  Inadequate  baoauaa  of  low  proficiency, 
and  Mgr  bare  fait  that  If  proficiency  had  baen  wore  normal  the  performance 
would  haaa  baen  adequate.  He  night  the  relb  re  enter  "adequate"  on  hla 
•newer  font.  The  feet  that  the  cooperative  judge  rated  the  actual  per*- 
fomanoe  "Inadequate"  had  no  relation  to  the  evaluator' a judpamt  of  what 
It  would  have  been  If  proflolenqy  had  been  tjploal. 

Thla  point  wee  not  fully  graaped  fay  ell  nee  bare  of  the  AMTEO 
Many  fait  that  the  wore  factual  data  provided  a check  on  the  leaa  reliable 
data*  The  HueRHO  adviser  nade  the  point  many  tinea  and  on  one  occaalon 
In  a formal  paper*  (Soe  Appendix  U.) 

B.  Early  Definition  of  Paokagee 


A prooedura  had  to  bo  devlaed  fbr  aeleotlng  and  definin'  the 
outputs  to  be  neasured  In  the  teat.  The  HunRRO  advlaor  reooneended  that 
the  offloera  cone  tract  a list  of  the  objectlvea  for  each  system  In  the 
ATTt  field  any.  These  ob joe  tires  were  to  be  broken  into  subobject  ivea 
and  aub-eubobjeotivas  until  the  latter  were  approximately  the  earns  level 
of  abstract ion*  When  some  of  the  sub-aubobjeetlvea  in  one  system  were 
ooneidered  to  be  the  appropriate  level  of  abstraction  they  wars  used  as 
wodala  fay  offloera  working  on  tha  other  systems.  Help  In  determining  the 
appropriate  level  wee  given  infernally  fay  the  BtaeRJU  adviear*  This 
proaachira  tended  to  ensure  oomplete  coverage  of  all  outputs  that  it  waa 
appropriate  to  measure.  Having  tha  objectlvea  at  tha  higher  level  of 
abstraction  mads  It  easier  to  detect  omissions  at  lower  levels* 
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for  Moh  aub-eubobj active  one  or  aoro  quart  Iona  war*  prepared 
to  determine  the  adequacy  of  output  by  the  unit  Involved*  (Objectives 
of  tho  aystens  worm  outputs  of  tha  various  eubaystans  or  units  of  tbs 
lsrgsr  ays tana.) 

One  of  tho  early  tendencies  of  tha  question  writers  was  to  "beg 
the  question*"  An  Illustration  of  this  tendency  is  such  a question  as 
the  following*  "Was  ooansnd  oontrol  wore  difficult  whan  units  wars 
widely  dispersed?"  It  wss  already  known*  of  oourse,  that  onwanrt  oontrol 
would  he  uore  difficult,  but  the  units  had  boon  dispersed  to  increase 
Invulnerability „ In  this  osse,  the  question  that  really  needed  an  answer 
would  be  whether  adequate  ornaand  oontrol  was  possible  under  such  condi- 
tions* The  HunRRO  adviser  was  active  in  pointing  out  instances  of  this 
kind. 

The  foregoing  description  Is  sonaahat  overs  i*pl if  iedj  actually, 
nany  of  the  questions  wars  irrelevant  and/or  did  not  follow  Tram  the 
objectives  and  their  sub- categories  or  l^lioatlons.  Also,  the  level 
of  abstraction  varied  fraa  one  question  to  another)  sane  questions,  such 
as  the  preceding  ezaaple,  were  In  terns  of  the  discarded  categories  of 
nobility,  ooanumd  oontrol,  flexibility.  Invulnerability,  and  fire  powero 
Although  undesirable,  this  situation  was  Manifestly  one  which  would 
develop  whan  the  questions  wars  being  prepared  before  the  approach  to  tho 
pro  blew  was  finalised.  The  AMTBQ  testing  progran  wss  on  a "crash"  basis) 
to  avoid  In  the  future  the  sort  of  problw  that  arose,  the  HvaAft)  adviser 
raooi  ended  that  testing  progr— a be  established  four  Months  before  the 


operational  planning* 


°*  *ha  hAiabilitf  of  lnlMtor«a  JudManta 

Oanarally,  d^andant  varlabla#  mn  matind  only  onoa  fay  inqr 
offlssrs.  Tbs  Mbar  of  a valuators  asslyisd  to  AHTSO  mm  not  largo 
saough  to  prorlda  nova  than  m oaaaumaant. 

Tho  RvmRRO  advisor  found  no  way  of  aaaaaalng  tha  ral lability 
of  tha  avaluator'o  judyaanta  during  tha  nanauvar.  inong  othor  things, 
tha  anas  brsadth  and  dapth  of  Any  aapsrlanoa  that  want  Into  tha  Miring 
of  tha  judpnnts  would  bs  raqulrad  fbr  ohaoklng  thair  ral lability.  Also, 
tho  paokagaa  that  wars  naaaorad  wars  usually  not  dlsarata.  Host  of  than 
wars  rathsr  oontlnuouo  through  tins  and  thair  adaquaqy  dapandad  on  anount 
par  unit  tins  aa  wall  aa  oontant.  m May  oaaaa  thara  was  not  anough 
tin*  in  tha  waMuvsr  to  ba  ooMldarad  aa  a "unit  tin*,"  aopaoially  in  tha 
raoupply  of  Mtsrlala  that  waar  out  ruthsr  than  baing  oonau— d. 


I.  Introduction 


This  section  oontains  suggestions  regarding  the  nature  of  future 
tests  of  Army  oonospts.  To  take  the  suggestions  out  of  the  reals  of 
pure  opinion,  certain  theoretical  points  are  developed  before  the 
speel fio  suggestions  are  stated.  These  points  will  not  be  new  to 
scientists)  they  have  simply  been  seleeted  and  organised  in  such  a way 
that  they  focus  on  the  problem  of  tests  of  Any  oonospts.  the  writer 
feels  that  the  suggestions  follow  naturally.  If  the  reader  disagrees 
with  these  suggestions  it  should  be  a simple  natter  to  identify  the  basis 
of  the  disagreement  in  the  theoretical  analysis. 

The  applications  of  selentifle  principles  to  the  SAGEBRUSH  tee to 
will  be  referred  to  or  elaborated,  to  provide  a basis  for  the  more 
theoretical  dlseusalon  as  well  as  a demonstration  of  how  these  points 
apply  to  the  relatively  staple  SAGEBRUSH  tests, 
n.  Building  a Test  Criterion 

A.  Measurnesnti  of  the  Elements  In  a Test  Criterion 
1.  The  notching  process 

Whether  a measurement  or  matching  process  is  simple  or 
ccwplioated,  it  always  requires  the  perception  of  a human  being.  For 
instance,  to  measure  length,  the  scratches  or  masks  on  a measuring  rod 
are  matched  or  oompared  to  marks  on  the  edge  on  acme  other  material.  If 
the  scratches  on  the  rod  match  the  marks  on  the  other  material,  according 
to  the  perception  of  the  observer,  the  second  material  is  said  to  be  the 
same  length  as  the  dlstsnoe  between  the  marks  on  the  rod.  There  nay  be 
many  "aids"  to  perception  (such  as  optical  systems),  but  even  so,  it  is 
still  a Judgment  0f  « human  being  as  to  whether  a match  has  been  accom- 
plished. 


The  aspect  of  the  Measuring  prooess  that  dateminaa  the 
"factualnese"  of  the  judgaent  la  the  amount  of  agresnent  from  independent 
observers  that  night  occur  in  a given  situation.  If  all  observers  agree 
that  a natch  has  been  accomplished  the  judgmmt  is  said  to  bo  a "fact." 

In  the  physloel  sciences  measurement  techniques  are  so  advanoed  that  we 
take  short  outs  in  arriving  at  the  appellation  "fhet"j  for  example, 
Hatching  achieved  by  one  person  using  an  ordinary  yardstick  is  usually 
reliable  enough  to  be  considered  a "fact"  for  everyday  usage.  However, 
the  very  same  Measurement  would  not  be  oonsidered  a "fact"  in  a situation 
that  required  micrometer  aoouracy*  Thus  a "fact"  is  not  absolute  but 
always  relative  to  the  amount  of  acouraqy  required  in  a given  situatlono 
2a  Obits  of  measurement 


The  matching  prooess  described  requires  that  the  comparison 
item  have  some  aspeot  which  oan  be  measured  in  the  sane  units  as  the 
criterion.  For  example,  the  tensile  strength  of  a bar  of  steel  is  not 
directly  measurable  in  teas  of  length,  but  we  oan  structure  a situation 
so  that  bar  of  steel  will  be  responsible  fbr  an  output  that  will  give  a 
measure  of  tensile  strength  in  teas  of  length.  When  a heavy  weight  and 
a pointer  aa  attached  to  the  steel  bar,  the  distance  (or  length)  that 
the  pointer  novae  1s  then  an  Index  of  tensile  strength 

This  prooess  Involved  the  addition  of  two  "systems,"  the 
steel-bar  system  and  the  weight  system.  The  joint  output  of  those  two 
systems  was  In  the  sans  units  as  the  criterion,  namely  length,  hy  com- 
paring the  displacement  of  the  pointer  with  the  length  criterion  the 
tensile  strength  of  the  bar  was  dsteained.  Ho  re  exactly,  the  "tensile 
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strength"  of  tho  Joint  product  of  tho  two  gyatMa  mm  measured.  However, 
tho  weight  and  pointer  uyotca  la  hold  oonatant  or  ”oontrx>lled"  In  aeMure» 
■onto  of  tonalla  strength)  tho  saw#  weight  oould  bo  usod  to  mmuto  tho 
taMllo  atrongth  of  another  a tool  bar.  If  tho  pointer  acred  a different 
dlatanee  with  tho  other  ateel  bar  we  would  oay  that  the  latter  had  a 
different  tone  lie  atrongth.  Of  oourae,  strictly  speaking,  the  tonalla 
atrongth  would  again  be  a Joint  produet  of  the  now  bar  system  and  the  old 
weight  and  pointer  ayatea.  But  alnoo  the  weight  and  pointer  Input  into 
the  Joint  ayatea  la  Identical  in  both  omm  wo  know  that  the  dlfferonoo 
reaulta  from  the  dlfferonoo  In  the  two  bar  ayatoae.  An  aiwlogy  to  the 
tensile-strength  analyalo  of  ayatoae  will  be  aade  later  In  thla  paper. 

B.  Selection  of  tho  Bleaenta  In  a Teat  Criterion 
lo  Unlaportant  eloaanta 

Every  ayatea  In  an  Anqr  bee  certain  outputa  that  are  un~ 
laportant  to  the  Any)  by  unlaportant  we  naan  tint  the  eye  tea  would 
function  Just  m well  without  thea.  For  instance,  some  outputs  of 
ayataaa  that  repair  radio  and  radar  equlpaant  are  burnt  tubes,  resistors, 
condensers.  All  outputs  celled  "waste"  are  undeeired  outputs;  there  are 
aany  other*  that  ere  neither  desirable  nor  undesirable  but  merely  of 
alnor  laportonoo.  It  la  often  difficult  to  say  what  In  of  alnor 
idiat  la  of  aajor  Importance,  but  such  judgaenfea  ax*  aade  every  day;  aoae 
thing*  reoeive  lamed  late  detailed  attention  and  other*  ax*  relegated  to 
ooooadaiy  laportonoo. 

Whan  e orltorlon  la  built  fbr  aoaeurlng  a ayatea  or 
qretaa*,  oaly  tho  outputs  which  are  of  son  Importance  are  selected  fbr 
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nwnt)  all  art  not  measured.  Strictly  speaking,  the  onlaaloa  of 
the—  outputs  from  the  criterion  ■eaanr—ont  la  an  lnatanoe  of  naaaurlng 
from  a reduced  frame  of  reference.  Whenever  we  aeaaure  In  a criterion 
ituatlon  that  la  not  actual  coabat  we  arc  leaving  certain  things  out, 
bat  thle  need  not  bo  a disadvantage.  We  oan  make  predlotlona  Aron  a 
reduced  frame  of  refarenoa  and  be  accurate  with  reepeot  to  the  laportant 
functions  of  a syetewo 

It  la  atlll  a natter  of  Judpwnt,  however,  aa  to  which 
outputs  are  important,  or  no  at  Important.  Expending  a given  testing 
effort  on  the  neasureaoat  of  even  oonoelvable  output  does  not  neoeav 
sarlly  produoe  the  cost  accurate  prediction  of  effectiveness  j it  la  no  re 
likely  that  aore  accurate  predictions  will  result  fren  amending  wore  of 
the  testing  effort  on  the  noat  laportant  output(a).  Of  course,  if  an 
unllalted  testing  effort  were  possible,  the  beat  prediction  would  be 
aada  by  Measuring  everything.  The  question  of  which  things  ere  the  aost 
laportant  to  Measure  la  therefore  a natter  of  praotioal,  not  theoretical, 
prediction  ac  curacy  <>  In  the  practical  situation  we  almost  always  aeaaure 
fron  a reduced  frame  of  reference  and  get  better  predictions  because  of  itD 
2o  Bias  oaused  bar  selection  of  elements 

Although  efficient,  the  prooees  of  ellnlnstlng  sons  outputs 
from  eons ids ret ion  in  a test  la  dangerous.  It  la  the  process  that  leads 
to  bias  in  a test  or  enables  a teat  to  bo  "rigged"  (that  la,  the  results 
of  aqy  "tost"  may  bo  predstamlned  by  the  experimenter  by  Measuring  only 
the  "good"  offsets  of  a system  and  not  the  bad).  For  axanpla,  a tooth- 
paste nay  be  "teeted"  end  found  to  destroy  ell  bacteria  In  a single 
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bcuahlng.  thla  tNt  Mgr  bo  rigged  in  that  it  Mgr  not  include  MiunMi 
of  this  toothpaste's  of  foot  on  tho  lining  of  ths  south.  Tho  toot  mqt  bo 
qplto  foot ool  about  tho  offoeta  on  booUrla  but  fall  to  oovor  tho  offtot 
that  om  brushing  also  das  troys  tho  llnli*  of  tho  south.  Thus,  it  la  not 
oaough  for  a toot  to  bo  "factual"!  It  suot  bo  unbiased  aa  wall. 

Horoln  Uoo  tho  danger  of  allowing  civilian  oolsntiata  to 
sako  toots  and  produoo  "answers"  without  a validation  prooodurs  oontrollod 
tgr  tho  Angr.  In  this  papor  tho  phrsso  "tooting  fTos  a roduood  fraso  of 
rofononoo"  roforo  to  lnstanooo  where  such  action  has  lntroduood  a dlatlnot 
bias.  In tont tonal  or  unlntontlonal,  into  tho  toot|  it  la  not  uood  in  tho 
otrlot  oonoo,  to  naan  that  tho  allghtoot  chongo  from  tho  actual  to  toot 
oltuatlon  oonatltutoo  a reduction  In  fraso  of  rofsronoo. 

y Pro  hiss  of  roduood  fNna  of  rofuunoo  In  tho  Arsy 

Thla  praotioal  sattor  polnto  up  a oono Idsrablo  problos  In 
tho  A nay.  As  a nils  tho  higher- rank lag  offloors  bars  a wldsr  perspective, 
or  frMo  of  rofsronoo,  for  tho  various  outputo  of  tho  various  gyotsso  than 
do  tho  lowor  ranking  offlooro.  It  is  also  trus  that  an  off! oar  who  is 
responsible  for  producing  a given  output  Mgr  not  bo  aware  of  tho  lapll- 
ostiona  or  lsporfeonoo  of  that  output.  Rla  auporlor  offioor  will  have  a 
bettor  view  of  tho  output' a lapllootlono  but  leae  knowledge  of  tho  details 
of  produolng  it.  The  next  offioor  up  tho  chain  of  oossand  has  a at  ill 
wldar  perspective  and  knows  still  loos  about  tho  details  of  production. 
ThM  tho  peroon  who  knowo  tho  soot  about  o given  syatss  knows  tho  least 
about  how  that  ays  tan*  a output  flta  Into  tho  osmII  fraso  of  reference* 
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The  point  of  this  iHiimlnn  Mgr  bo  smmsrlood  by  o 
gonorol  ruloi  Outputs  ooneltersd  bo  bo  Indices  of  tho  sffoetlwonsao  of 
syotoms  should  bo  qualitatively  und  gutttitlfily  defined  by  tho  porson 
or  agency  with  tho  oppraprloto  perspective,  and  tho  ■oopurionto  of  thooo 
outputs  should  bo  mode  bar  tho  porson  or  agm qr  boot  quollflod  to  measure 
the*  within  tho  ootsbllshod  dsfinltlons.  This  rulo  Is  not  assy  to  apply 
uhsa  tofltanolo(lool  odronsos  provide  now  outputs  with  which  no  ono  Is 
ssporlonood*  Moreover,  thsso  now  outputs  ml^it  noko  obsolete  largo 
systems  that  previously  produood  similar  outputs,  (for  lnstanoo  certain 
oy otws  with  o nuoloar  output  might  conceivably  noko  obsoloto  systems 
composed  of  oortaln  conventional  artillery  weapons  which  produood  non- 
nuelear  outputs.)  In  such  esses  entlrsly  new  porspoetlvoe  os  wall  as 
new  techniques  of  product  ion  will  bo  required. 

Da  s unit  profloioncy  toot  there  Is  little  danger  of  testing 
from  s reduced  frame  of  reference,  beoeuse  such  e test  implies  s situation 
where  the  responsible  officer  knows  all  the  outputs  and  Inputs  of  the  sub- 
system. Ho  new  equipment,  weapon,  organisation,  or  dootrlns  Is  being 
tested.  An  Army  proficiency  test  Is  merely  o test  to  see  if  the  unit  oen 
produce  its  defined  outputs  the  seme  my  similar  units  haws  produood  then 
in  the  past. 

This  type  of  test  also  implies  a backlog  of  Information  on 
stellar  units  which  servos  as  s criterion  for  oomparlson.  Presumably 
thooo  standards  of  comparison  haws  been  obtained  from  eonbet  experience) 
predict  lone  of  unit  profloioncy  booed  on  those  conditions  and  standards 


are  exactly  tha  oondltlona  that  will  obtain  lass  and  laaa  aa  the  Amy 
ohamaa  to  utilise  naw  taohnologloal  darelo|»«nta. 

li.  Correspondence  of  outputs  in  tha  standard  and  "nan*  arnlaa. 
m tha  SAQBHUBH  taats  it  uaa  not  always  poaalhla  to  oooh 
para  tha  outputs  of  a unit  oar  ayateu  with  tha  outputs  of  similar  units  or 
aystana  In  tha  standard  axuyj  in  seas  oasas  an  asset  ona  to  ona  oorre- 
spondanoa  did  not  ax  1st.  Fbr  lnetanoe,  In  tha  ATM  anqr  tha  nalntananoa 
funetlons  of  tha  Ordnanoa  and  Signal  Corps  wars  "split  off”  and  fbmod 
into  a now  organisation,  a "nalntananoa  gyoton."  This  ajstsn  had  no 
oountarpart  In  tha  atandard  azuor.  In  this  oaaa  outputs  produoad  by  tha 
nalntananoa  aystan  oould  generally  ha  Idantlflad  with  tha  onas  produoad 
hgr  tha  signal  and  ordaanos  systsua  In  tha  atandard  arugr.  Thasa  outputs 
uara  not  identloal,  baoauaa  they  ware  not  produoad  on  tha  aana  schedule, 
looatlon.  or  request  basis,  hut  tharu  was  enough  slailsrlty  fbr  tha 


It  la  also  poaalhla  to  go  ona  a tap  olasar  to  tha  final 
flsld  amy  outputs  (outputs  which  are  Inputs  to  tha  mamsj)  and  obtain 
naasurenants  that  uara  In  tha  aana  units.  That  la,  by  Measuring  tha 
outputs  of  units  to  whloh  both  tho  atandard  ayatsn  and  tha  nan  nalntananoa 
Sfsten  supplied  Inputs,  ths  affbotlrensas  of  tho  standard  and  nsu  system 
oould  bo  Judged,  m other  words,  tho  naw  and  standard  system  did  not 
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rwtputa  of  tho  ayui—  Into  which  tho  outputs  of  the  now  and  otondard 
aolntononoo  iy1—  wont  otlll  produood  outputo  that  woro  nooouroblo  In 
tho  oono  tom.  Thao  tor  difforoneo  found  nay  bo  attributed  to  dlffor- 
->ooo  In  tho  etandard  and  now  aolntononoo  nyatene  uhloh  undo  difforont 
lnputo  into  tho  eyatono  actually  noaourod.  (Naturally  tho  eyatama 
actually  noaourod  auet  bo  aqua  tod  by  replication  or  axperianoed  Judgment.) 
This  lo  one  ample  of  how  changeo  in  tho  Anqr  will  affect  tho  dotaila  of 
given  oyotn—  before  tiny  affoot  tho  outputo  of  qroton  that  arc  o loo  or 
to  tho  final  output  of  tho  field  any* 

$•  SAGEBRUSH  taato  woro  not  from  a roduood  frano  of  roforonoo. 
Several  footoro  nako  it  unlikely  that  tho  tooting  approach 
of  noaourlng  major  outputo  and  lnputo  during  SAGURUBH  oonotituted  a toot 
from  a reduced  frono  of  refaronoo.  First,  there  la  a background  of  know- 
lodge  fTon  tho  otondard  any  with  regard  to  tho  outputo,  oven  though 
unit  otructurs  nay  have  boon  ohangod.  Sooond,  any  input  important  enough 
to  affect  a unit's  output  would  oauoe  tho  officer  rooponoiblo  for  that 
unit  to  oall  attention  to  tho  input  ae  an  iaportant  dote  miner  of  hie 
output.  Thio  in  offeot  would  bo  a definition  of  Inportanoo.  It  would 
alao  be  a derivative  of  prevloua  experience  with  alailar  unite.  Third, 
tho  outputo  to  bo  noaourod  during  8AGRBRUSH  (oeverel  thouaand)  were 
defined  in  advanoo  by  nilltaiy  experta  through  a technique  of  defining 
tho  major  ohjcotlvoe  of  a nyoton,  tho  eubohjeotiveo  of  each  objective, 
and  oo  on.  Thaee  hiorarohlee  of  ohjoctlvee  woro  roviawod  for  oowploto- 
neoa  by  aenior  offioero. 


Invulnerability, 
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of  nrUblaa  no* dad  for  futur#  taata. 
m oarll ar  approach  adopted  by  tba  AMTEO  bad  baan  to 
tag  la  tana  of  flv*  variable*— nobility,  flexibility# 
oontrol,  and  flra  powar— daalgnad  to  daaerlba 
oatagorlaa  ara  ao  abatraot  that  thgr  bar*  not 
dtflaad  la  oparatloaal  tonaj  they  ara  auoh  Ilka  lntarvaali*  vari«. 
aUaa  la  a aodal.  by  attaapt  to  "aaaaun”  In  tana  of  that  would 
undoubtedly  load  to  ooaltaalon  of  thIth  and  aalaaion  of  nany  lnportant 
fhotora  ("oalaalon  of  iaportant  factor*  of  output* ” la  anothar  way  of 
oaylag  "raduoad  frana  of  nfamnoa”).  But  thla  la  not  to  *ay  that  that 
kind  of  approach  la  thaoratloally  poor.  It  la  probably  good  In  tha  sanaa 
that  oon* traction  of  aodala  with  a llaltad  nunbar  of  tha  aoat  Iaportant 
warlablaa  la  a ganaral  aolantlflo  approach.  Thla  toplo  will  ba  takaa  up 


latar. 

IH.  3ouroaa  of  Error  la  tha  Taata  QtiXlalng  a that  Criterion" 

In  tha  opinion  of  tha  writer,  tha  aouroa  of  arxor  with  whloh  tha 
payohologlat  la  traditionally  oonoamad— tha  paroaptual  error— 1*  a 
relatively  minor  ooa  In  tha  "theory  tooting"  experiment*  of  tba  Any. 

Tho  pnblaa  In  tooting  now  Any  organisation*  will  bo  on*  of  aolaetlng  tha 
aoat  Iaportant  aouroa*  of  variation  with  nopoet  to  Any  output.  If  only 
tho  aaall  aouroa*  of  variation  ara  aaoaurad  thla  will  ha  a largo  aouroa  of 
arror  with  nepaot  to  tho  predictive  aoouracy  of  tho  toot. 
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of  error  la  tte  toting  proeMi  — y b • wtiforlMd 


as  follow  t 


(1)  The  perceptual  error  la  —tubing. 

(2)  Linited  control  of  oonfoundlng  factors. 

(3)  Tho  reduoed  Arena  of  referenoe. 


A*  Tho  Berooptuel  Error  In  Neteh 


Experlnente  Inply 


mro— nt  requires  a 


otondord  against  which  to  — toh  tho  output  of  tho  eyet—  —dor  invest  i- 


C*t  Ion.  In  o^>iriool  stud  loo  o oontrol  group  lo  typically  ouppliod  aa 
tho  standard.  Carta  in  dlaonolono  of  output  aro  oolootod  for  asssuro- 


it  on  tho  standard  sad  experlaental  groups,  and  thooo  rll— n slons  are 


lurod  and  ooaparod  or  "notched"  fbr  tho  too  groups. 


In  otudloo  of  nilitary  oubjooto  tho  control  group  la  often  a 


group  fron  tho  standard  any*  It  happens  that  thore  is  a largo  boty 
of  knowledge  about  groups  fron  tho  standard  any.  A ray  officers  have 


soon  th— o groups  porfara  and  know  a considerable  Mount  about  their 


outputs.  Officers  aro  oortalnly  not  a— ilsolontf  In  foot,  for  assy 
purposes  it  is  not  exact  enough  to  serve  as  a standard  of  ooaparioon.^ 
Still,  the  foot  r—al  ns  that  oortaln  things  aro  known  about  such 


oontrol  groups,  and  this  Is  son— hat  novel  In  tho  oxperlsnoo  of  scientists 


uho  have  done  their  work  In  laboratories.  It  would 


that  for  oortaln 


where  gross 


ore  needed,  infometion  An—  experienced 


y fbr  lnotanoe,  the  msebor  of  eaa unities  produced  by  e rifle  squad  at 
night  la  not  known  In  quantitative  tome  fron  oenbet  experience. 
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person*  might  be  used  as  a standard  of  reference  in  liau  of  a control 
group*  This  kind  of  "experienced  opinion"  control  will  not  neoessarlly 
bo  Inferior  to  tha  physical  control  group  under  all  oonditiona. 

The  SA0HBR08H  statfer  nay  be  an  exanple  of  the  situation  In 
quoetlon.  Data  regarding  the  output  of  unite  In  a realistic  setting 
were  needed  In  SAGEBUBH.  In  the  strict  sense*  oontrol  groups  would  have 
oonsisted  of  units  performing  under  the  standard  organisation  and  doctrine 
(Aggressor  side))  however*  the  difficulties  of  asking  each  oontrol  unit 
perfora  under  the  sans  conditions  as  its  counterpart  experiment  si  unit 
(on  the  Uo  S.  side)  were  practically  Insurmountable . The  standard  of 
reference  was  the  expert  opinion  of  officers  who  had  seen  similar  units 
perform  under  many  conditions  In  ooabat.  It  was  not  difficult  for  than 
to  observe  a SAGEBRUSH  unit  and  compare  its  performance  (or  output)  with 
that  of  standard  units  they  had  observed  before*  The  dimensions  on  which 
the  unit  was  ooapared  did  not  require  exact  quantification  but  only  non- 
parametric  data — judgments  of  "better  than"  or  "worse  than." 

The  desirability  of  using  oontrol  groups  in  such  an  Instance  la 
problematical.  The  error  that  would  have  resulted  from  "forcing"  oontrol 
groups  Into  the  sane  kinds  of  conditions  as  the  experimental  groups  would 
quite  likely  have  been  greater  than  the  errors  In  an  experienced  observer's 
recollections.  It  la  argued  here  that  the  perceptual  error  la  not  always 
the  greatest  one  In  a practical  situation*  and  that  efforts  to  reduoe 
that  error  may  In  some  eases  produce  greater  errors  from  other  souroes. 

Studies  in  which  no  oontrol  group  is  employed  should  not 
categorically  be  considered  non- valid.  Since  validity  is  a matter  of 
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degree  and  dependent  on  accumulated  error,  Moh  om«  should  be  oansl4ered 
on  the  basis  of  the  expertaental  arrangsm ant  that  reaults  in  the  least 
aocimulsted  error*  (The  umplree  who  asseeaed  the  units  constituted  a 
apeolal  oaae  with  respect  to  peroeptual  error.  In  that  the  evaluators' 
perception  often  bad  to  follow  from  the  umpires'  perception  and  aaaeaa- 
mMit.) 

Bo  Limited  Obntrol  of  Oonfbundlng  Factors 

A second  source  of  error  In  the  testing  process  la  allowing  one 
or  no  re  of  the  87a tens  contributing  to  a Joint  output  to  very  randomly 
while  enother  system's  contribution  to  that  same  joint  output  Is  being 
measured  .V  This  Is  an  lnatanos  of  lack  of  oontrol.  Let  us  look  at 
oontrol  this  wayt  It  oan  be  achieved  fay  control  groups,  but  there  are 
other  techniques  as  well. 

The  output  of  ary  system  Is  the  produot  not  only  of  that 
system  but  of  all  systems  which  supply  an  Input  to  It.  The  output  of 
a given  system  Is  thus  the  joint  output  of  Its  own  and  all  auxiliary 

systems. 

1.  The  fhotor  of  external  conditions 

A apeolal  category  of  Inputs  are  those  Introduced  to  a 
ays  tern  through  the  external  conditions  in  whloh  the  system  performs. 
Weather  and  terrain  are  examples  of  this  type  of  Input  In  Arsy  situ- 
ations. The  Inputs  of  weather  and  terrain  are  from  a system  external 
to  the  Army)  as  Important  factors,  however,  they  must  be  considered 
In  a testing  program. 

1/  Factors  whloh  did  vary  randomly  arc  listed  In  Appendix  B. 


8.  The  factor  of  Inputs  froa  anolllaiy  system 


Ths  Inputs  of  ancillary  system  do  not  nssd  to  bo  oon- 
trollod  tor  nsans  of  oontrol  groups)  ths  necessary  oontrol  nay  bo 
achieved  by  artificial  insort  ion  of  ths  inputs,  that  Is  by  supplying 
ths  ayaten  under  evaluation  with  "in  tolerance"  inputs  froa  souroos  under 
ths  oontrol  of  ths  experimenter  rather  then  froa  other  functioning  system* 
m that  mgr  ay  teas  mgr  bo  tasted  cm  at  a tine.  After  they  era  tested 
Individually  it  is  desirable  to  test  their  Joint  output,  beoauso  certain 
of  the  Inputs  intro duoed  artificially  night  have  been  incorrect  values  or 
aijfit  have  been  froa  a reduced  fraM  of  reference.  The  over-ell  test 
night  lead  to  farther  individual  teats  or  the  Joint  output  night  be 
satisfactory*  The  entire  process  is  one  of  successive  approximations.' 

3*  The  factor  of  Internal  conditions 

Another  source  of  error  in  teats  of  Any  concepts  of  the 
sane  type  lies  in  conditions  internal  to  a ayaten.  If  the  ays  tea  is  not 
uhat  it  is  purported  to  be,  an  error  will  result.  In  any  system  this 
is  s vary  real  souroe  of  error.  The  profiolenqy  of  the  non  in  one  aspect 
of  a ayaten  that  nay  be  out  of  tolerance.  Condition  and  quantity  of 
equipnant  is  another.  Still  another  is  under-etrength  units,  (under 
strength  in  non  or  equipnant).  This  kind  of  uncontrolled  variation  was 
probably  the  greatest  souroe  of  error  in  the  SAOURUSH  tests,  greater 
than  the  errors  of  perception.  Nary  units  and/or  ays  tana  were  out  of 
toleranos)  in  migr  oases  the  outputs  of  one  ayaten  resulted  in  out-of- 
toleranoe  inputs  to  aaay  system.  The  ooonun  lost  ion  ayaten,  for  instanoe, 
was  far  below  acceptable  levels  during  the  maneuver,  and  alnoe  this  aystm 
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•applied  input*  to  almost  all  other  yrtw  the  outputs  of  ell  those 
others  sere  affected*  This  ms  also  tins  of  other  system  bssldss 
oo— ualcat loos , but  to  a lesser  degree* 

ho  The  ocmblned  error  Aram  all  three  fhetors 

The  orer-all  effect  In  SACTOHUBH  was  extreme  oonfoundlng. 
Westher  and  terrain  inputs  wore  fairly  typical  of  the  oonditlons  for 
uhleh  the  test  was  designed  to  predict,  so  this  was  probably  not  a large 
source  of  error.  A large  source  of  error  lay  In  the  Internal  structure 
of  the  eyste—  j personnel  were  well  below  typical  proficiency  and  units 
were  under  strength  In  personnel  and  equip— nt.  And  of  oouree  when  one 
unit  was  out  of  tolerance  for  any  reason  it  caused  others  to  perfom  out 
of  tolerance. 

C.  Comparison  of  the  Perceptual  and  Confounding  Sources  of  Error 
in  SAOBBRDBH 

There  are  no  quantitative  data  regarding  the  a— unt  of  error 
contributed  by  the  lack  of  oontrol  of  these  factors  as  opposed  to  that 
contributed  by  the  perceptual  comparisons  In  the  SAGEBRUSH  tests.  The 
writer  and  all  the  — abers  of  the  AMTEO  believe  that  the  contaminating 
Influence  of  out-of-tola ranoe  system  was  by  far  the  greatest  Invalidating 
faetor  in  the  SAGEBRUSH  tests#  If  tests  of  this  type  are  to  be  aede  more 
valid,  future  scientific  and  military  effort  should  be  directed  toward 
this  source  of  error  rather  than  toward  the  perceptual  source  of  error. 

Df  The  frame  of  Reference  Error 

One  other  source  of  error  exists  t Error  Is  prodooed  by 
asssurlng  Aran  • rsdoosd  frame  of  rsforenoe,  s matter  already  discussed 


ill  general  t«mi«  In  tha  SAGEBRUSH  tests  thin  van  probably  not  a 
relatively  large  souroe  of  error.  An  atteapt  waa  made  to  haw  aa  rony 
aystaro  operating  aa  poaelble,  and,  with  the  AKIBQ  procedure  of  identic 
tying  Objective#  and  eubobjectlvee  for  review  by  all  Aragr  eohoole, 
probably  no  rojor  out puta  of  theae  varloua  aye taro  that  were  Inputa  to 
other  aye  tana  were  overlooked. 

For  adalniatrative  reaeone,  the  outputa  that  were  Inputa  to  the 
may  fbroaa  were  not  all  oonaldered  for  roaeur—nt.  The  AMRO  waa 
given  responsibility  for  teatlng  only  on  the  0.  S.  aide)  not  until  after 
none  work  on  the  problem  of  teatlng  had  bean  done  waa  It  real  lead  that 
the  over-all  effeetivenoaa  of  the  0.  S.  aide  oould  be  eeaaurod  by  lta 
effbet  on  the  Aggraaaor  aide.  Rather  thro  change  plana  at  a late  date. 

It  waa  decided  that  the  effect  on  the  Aggraaaor  aide  would  not  be 
neaaured. 

Certain  other  practical  oonalderationa  alao  entered  Into  thin 
dec  la  Ion.  For  one  thing,  the  joint  output  of  all  the  ax^r  aye  taro 
would  be  oontrolnated  by  ao  rosy  eouroee  of  error  that  it  would  be 
alnoat  lapoaalble  to  partial  out  the  oonfbundlng  factors  fraai  the  faotore 
of  organisation  and  doo trine. 

Teatlng  of  this  over-all  output  la  certainly  a goal  of  future 
teatlng  prograro.  The  AMRO  fait  that  under  the  oondltlone  of  the 
SAGKBROBH  teat  auoh  roaaureront  would  not  ocntrlbuta  enough  to  warrant 
a change  of  plana  a nonth  or  ao  befbro  the  teet  wee  to  be  finalised. 
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ban  a ralstlvalj  —11  oowroo  of  error  in  ttao  SAGKBRUSR  too  to.  j The 
largoot  eource  of  orror  r—  tno  tho  look  of  oontrol  of  Input#  tram  tho 
various  uyoteao. 

IT,  Oontlnuan  at  Toot  Orltorlon11  Coaploulty 

Lot  us  now  carry  our  onologjr  of  tanslle-etrength  tooting  Into  a 
military  oottlng.  Tho  following  oraa pi  so  art  designed  to  show  thot  as 
wo  toot  variables  with  broods r and  broador  lnplloatlono  wo  extend  tho 
no— oory  tooting  progran  far  bagroad  our  pros  ant  oaoourlng  oopaoitgr. 


A,  A SHplo  Toot 

Lot  us  start  with  a olnplo  toot— evaluating  a newly  dovolopod 
shoo  solo.  It  la  entirely  within  our  praoant  capability  to  validly  toot 
a now  shoo  solo,  No  — add  tho  now  ohoo-oolo  oyotea  to  an  abraotao 
aye—  and  a— uro  tho  tins  It  tokos  to  woar  through.  Tho  sons  abroolvo 
ays  ton  — bo  applied  to  tho  old  shoo  sola  systaa  and  a oooparloon  nods, 

Tho  abroolvo  ajrotoa  nood  not  bo  a highly  structured  ono  In  a laboratory | 

It  — bo  non  wearing  oh— » 

It  nay  bo  soon,  however,  that  o—  oontrol  lo  loot  whan  wo  novo 
out  of  tho  laboratory  situation!  tbot  la,  wo  axe  not  so  sura  that  tho 
abroolvo  syotoa  lo  Identical  for  tho  two  ohoo-oolo  oyotsas  being  oooparod. 

Wo  oonnot  be  oure  tbot  tbs  two  ooto  of  oh—  will  got  tho  o—  trootnont. 

On  tho  other  bond,  wo  ore  no  re  oortoln  that  tho  typos  of  trootnont  which 
o—o  oh— Ion  in  field  use  will  occur  in  o "troop  toot"  than  In  o lab- 
oratory, This  aotaaplo  illustrates  that  wo  have  adequate  technique#  and 
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lnatruaaate  (both  laboratory  and  f laid)  fbr  validly  tooting  staple 
thing*  ouch  m oho#  aolee.  Wo  hare  uood  ahoo  ooloo  fbr  a long  tine 
and  hare  aoouroto  erltorla  for  tholr  wear. 

B.  A War#  Ooaplax  Toot 

A#  a aaaewhat  aore  ooaplox  exaapla,  lot  us  toko  a weapon  ouoh 
aa  tho  rlfla.  The  criterion  fbr  a rifle 'a  offeotlToneoo  la  In  teraa  of 
the  nuaber  of  oaaualtleo  it  produoes  in  enoagr  troopo.  This  orlterion 
la  aaallabla  through  the  judgment  of  experionood  offloera  who  hare 
obe erred  tho  effbota  of  rlflea  In  ooabet. 

In  ordor  to  obtain  a rifle  output  in  thoee  tema  a nuaber  of 
ajateaa  nuat  ba  addad  to  the  rifle  ays  tea.  To  the  systaa  lnrolrlng  the 
aon  needed  to  fire  the  rifle  aunt  be  added  the  oondltiona  (auoh  aa 
terrain,  weather,  light)  under  which  it  auat  be  fired.  Gneagr  troopo 
auat  ba  addad  aa  a third  ayatanj  other  factors  auoh  aa  weight  and 
nuabara  of  oartrldgoe  required  oould  be  added  aa  at ill  another  aye  tea 
lnrolrlng  supply.  Ha  can  teat  the  output  of  a glean  rifle  aystaa 
agalnet  another  In  texaa  of  the  orlterion  of  on  say  oaaualtleo  produoed 
whan  thoee  other  aye  tans  are  addad  to  aako  a joint  output  and  are  kept 
oonotant  oeer  different  rifle  ayateaa. 

leaping  the  output  of  all  those  ayateaa  oonotant  la,  however, 
not  a alnple  natter.  The  aore  aye  tons  that  are  contributing  to  the 
joint  output,  tho  greater  the  nuaber  that  hare  to  be  oontrollad  In  order 
to  aeaaure  the  effaota  of  one  of  then.  from  a tooting  point  of  else  it 
la  auoh  slaplor  to  ellalaato  other  ay  a teas  froa  a teat  than  to  hold  ibm 
constant.  This  prooedura  la  doolrable  If  a orlterion  of  the  effeotieaaeaa. 


SB  isolation,  of  tbo  sjmtoa  under  staty  is  available.  Such  a criterion 
is  not  sveilsble  for  tho  rlflo  eystam  alone,  booauae  in  oonbat  no  one 


oner  eeee  it  In  isolation  and  no  effort  haa  been  made  to  obtain  data  for 
snob  a criterion  in  a controlled  situation  o Obtaining  such  data  la  a 
step  that  oan  be  taken  only  after  the  effects  of  the  syeten  under  etudjr 
are  quantified  and  functionally  related  to  the  joint  output  of  the  con- 


tributing systems.  Therefore,  at  present  me  only  hare  information 
regarding  the  joint  effect  of  the  rifle  and  other  systems.  Stucty  of 


rifle  effectiveness  should  proceed  with  that  criterion.  Tbo  problem  of 
controlling  tho  other  njrnt sms  contributing  to  the  output,  which  is  in 


the  same  terns  as  the  criterion,  must  be  accepted  and  solved  if  the 
studies  ere  to  be  valid. 

In  considering  the  example  of  the  rifle  it  might  be  noted  that 
the  aocurecy  of  a single  slug  at  axtreme  ranges  haa  often  been  used  as 
a criterion  of  the  oombet  effectiveness  of  riflee.  By  eliminating  all 
other  systems,  this  criterion  makes  teste  quite  simple.  Unfortunately, 
however,  the  functional  relationship  between  rifle  accuracy  and  the 
combat  effectiveness  of  rifles  is  not  known  (and  it  is  certainly 
hazardous  to  assume  they  ere  identical).  Therefore,  basing  predictions 
of  the  combat  affootlvsnasa  of  rifles  on  the  accuracy  of  the  rifles 
will  not  result  in  the  beet  predictions. 

The  rifle  was  included  here  as  an  example  of  e system  where 
Indications  are  eo  broad  that  it  is  beyond  our  present  capacity  to 
validly  test. 
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The  next  ample  la  one  In  which  the  Implications  are  even 
broaden  the  tactical  atomic  weapons  now  becoming  available*  We  have 
no  experimental  criteria  regarding  the  effect  of  these  weapons  In 
oombet,  but  we  do  have  some  knowledge  of  their  effects  from  the  proving 
ground  teete.  From  that  knowledge  we  know  that  they  have  the  same  type 
of  effeot  as  the  existing  weapons  systems  (rifles,  tanks,  artillery, 
etc.),  but  we  know  also  that  their  potential  Is  greater*  Possibly  the 
effects  of  these  other  weapons  systsns  nay  be  better  achieved  by  the 
atonic  weapons  systems  than  with  the  system  currently  organised  for 
that  purpose*^/ 

In  order  to  solve  the  problem  of  what  balanoe  of  weapons 
Systems  will  achieve  the  greatest  over-all  effect,  a criterion  must  be 
available.  This  criterion  must  be  In  the  same  tens  (or  units)  as  the 
sun  of  the  terns  of  the  various  systems  Involved.  Such  terms  are  almost 
Identical  to  the  terns  in  which  actual  oonbat  Is  constituted.  In 


addition  to  the  weapons  system,  the  systems  of  Intelligence,  comauni- 


structure,  and  conditions  of  terrain  and  weather  are 


all  involved.  And  each  of  these  may  be  broken  Into  sub-systems  and 
sub-sub-systems,  the  smallest  of  which  would  be  on  a par  with  the 
factors  involved  In  the  wearing  out  of  shoes. 


1/  This  example  is  not  neent  to  raise  the  argument  that  every  time  a new 
weapon  Is  introduced  someone  thinks  that  it  makes  all  old  weapons 
obsolete.  The  example  Is  included  for  another  reason  and  a dlsousaion 
of  this  point  is  Irrelevant  to  that  reason. 


>«ww  fbr  the  mb— nt  that  such  an  appropriate  oriterlon  can 
be  constructed.  The  problem  of  controlling  the  effeets  of  all  thaee 
qratmae  In  the  joint  produet  while  measuring  the  effect  of  the  atoaio 
•ye tea  la  one  of  considerable  proportions.  However*  this  question 
requires  a valid  answer.  The  atoaio  weapons  exaaple  la  included  as  an 
axtreae  ease  having  iapl  lost  Ions  for  many  aye  teas)  as  the  laplioations 
grow*  so  does  the  difficulty  of  controlling  the  outputs  froa  all  of  the 
aysteas*.  A maneuver  auoh  as  SAGBBR08H  is  an  atteapt  to  produee  an 
appropriate  oriterlon*  but  the  oontrol  of  all  the  various  a jot  mm  is  an 
laposlng  task.  The  large  number  of  "contamination  factors'*  present  in 
SAOSBRUBH  attests  to  the  inadequacy  of  our  present  ospaelty  fbr  tests  ea 
this  seals. 

0.  Why  Ha  Are  Concerned  With  Joint  Outputs 

The  three  exsaples*  shoe  soles*  rifles*  and  atomic  weapons* 
were  selected  as  throe  points  on  a oont lnuue— that  of  an  increasing 
number  of  systems  involved  in  producing  a joint  output » 

Ms  aust  deal  with  this  oontinuua  because  we  are  Interested  in 
these  joint  outputs  and  beoause  we  usually  know  something  about  the 
criterion  situation  for  sueh  outputs.  Ws  are  interested  not  in  the  rifle* 
per  se*  but  in  the  joint  effect  of  a number  of  systems  of  vhioh  it  is  only 
one.  Ws  are  not  interested  in  the  Inherent  accuracy  of  the  rifle*  since 
we  do  not  know  the  functional  relationship  between  its  accuracy  and  Its 
combat  effectiveness  • Therefore*  because  of  the  nature  of  our  interest 
.we  aust  deal  with  a fhlrly  large  number  of  component  systems. 


There  la  nothing  inherent  in  the  various  systems  themselves 
that  causes  us  to  be  concerned  with  their  joint  effect j it  Is  s Imply 
that  In  the  over-all  activity  of  war  we  are  Interested  In  producing 
casualties a Corollary  to  this  statement  Is  the  fact  that  our  experi- 
ences with  criteria  are  In  terms  of  the  things  we  are  Interested  In* 

That  Is,  we  have  some  knowledge  of  the  number  of  casualties  that  oan  be 
produced  ty  rifle  fire  beoause  we  are  interested  in  that  effect  and  have 
observed  it.  Vie  must  therefore  test  those  systmae  that  produce  joint 
outputs  which  are  In  the  same  tens  (unite)  es  the  criteria  which  ve 
know  something  about. 

We  do  not  now  have  the  capaeity  for  adequately  testing  any  but 
the  simplest  of  sys tarns  (as  is  currently  done  by  QONARC  boards).  There 
is  no  reason,  however,  to  believe  that  the  process  of  quantif ioation  and 
determination  of  functional  relations  cannot  be  applied  to  military 
situations  just  as  it  has  been  to  other  eubjeot  matters.  The  first  step 
is  quantif ioation j the  second,  development  of  functional  relations n 
V.  Predictions  by  Quantification  and  Functions!  Relationships 

A qualitative  approach  to  systematisation  is  conceptually  simpler 
than  a quantitative  one  and  generally  comes  before  quantitative  adjust* 
ments  in  science.  In  general,  from  the  standpoint  of  test  development, 
the  Army  is  in  the  first  stages— the  qualitative  phase.  A "good"  aruy, 
in  this  scheme,  should  have  oertaln  qualifies! 

(1)  Flexibility 

(2)  Nobility 

(3)  Invulnerability 

(U)  Co— and  control 

(5)  F'ire  power  or  shook  aotion 


In  the  qualitative  conception  an  any  is  "good"  if  it  has  thaaa 
qualltiaa  and  "bad"  if  it  doaa  not*  This  approach  la  certainly  not 


wrong*  bat  lot  ua  ex— ins  ita  power  of  predict  Ion.  As  an  example, 
eonaldar  a Roman  legion*  Undoubtedly  an  army  of  today  oould  easily 
defeat  a Roman  legion)  yet  if  tha  legion  is  examined  for  the  five 
qualities,  it  will  be  seen  to  hate  had  them  all.  Ita  invulnerability 


waa  achieved  by  shields  and  boty  armor,  its  fire  power  by  spears,  swords, 
and  arrows,  its  mobility  by  marching,  ita  (remand  control  by  voice  com- 
mands or  simple  signals,  and  ita  flexibility  by  whatever  SOP' a were  used 
to  redistribute  the  effort  of  their  special  equipment.  Thus  it  may  be 
seen  that  a qualitative  analysis  la  not  a sufficiently  lncialve  tool  to 
describe  differences  between  a modern  any  and  a Roman  legion  that  can  be 
used  to  predict  the  winner  of  an  engagement  between  the  two* 

However,  if  each  quality  is  assessed  in  quantitative  terms,  the 
Roman  legion  la  shown  to  be  different  in  terms  of  our  "theoretioal 
analysis,"  just  aa  we  know  it  would  be  in  practice.  Today's  any  has 
greater  fire  power)  in  oertain  respects,  though  not  all,  it  has  greater 
mobility  and  more  Invulnerability.  The  advantage  that  the  modem  army 
has  in  co—and  oontrol  requires  a finer  quantitative  discrimination— 
although  control  is  aupaented  by  electrical  equipment,  the  modem  any 
is  mors  dispersed  and  hence  out  of  range  for  direct  control  by  voice. 

Thus  it  may  be  seen  that  a quantitative  approaeh  has  norm  predictive 
power  than  a strictly  qualitative  one. 

One  more  step  oan  be  taken  for  greater  predictive  powert  The 
Parameters  of  the  interrelations  between  qualities  oan  be  established. 
Basic  to  this  discussion  is  the  fact  that  the  five  qualities  aim 


interrelated.  For  sample,  a oertaln  amount  of  invulnerability  My  be 
aoh  laved  by  diaper*  Ion,  but  diaper*  Ion  In  turn  oaueee  a oertaln  loaa  in 
nn— and  oontrol.  The  question  My  be  poaeds  How  much  oo— nd  oontrol 
should  be  given  up  for  so  much  invulnerability?  Such  a question  not 
only  as  sums  quantitative  Me  a urea  of  both  oo— and  oontrol  and  Invul- 


nerability but  alee  requires  bom  knowledge  of  their  interrelation. 
Knowledge  of  this  Interrelation  (In  the  fore  of  a curve  or  function) 
would  lead  to  much  greater  predictive  aocuracy  than  would  staple  quanti- 


fication. In  fact,  if  the  Interrelations  of  all  the  qualities  were  known 
quantitatively,  the  theoretioal  formulas  would  have  eztrsMly  practical 
predictive  power.  The  aoooapllshMnt  of  this  quantification  and  f emu- 
lation would  be  the  objective  of  the  actant Is to 

The  five  quality  categorise  should  be  considered  only  as  examples 
or  points  of  departure)  they  am  not  necessarily  the  beat  ones  to  use 
in  the  proposed  formulation.  (Perhaps  the  10  principles  of  war  would 
be  better.)  The  skills  of  both  the  military  men  and  the  scientists  am 
required  in  order  to  structure  the  categories  or  qualities  that  would 
bo  most  easy  to  handle  and  yet  have  sufficient  predictive  power.  The 
categories  would  have  to  be  general  enough  to  allow  future  equipmnt 
and  weapons  to  fit  under  their  rubrics,  and  categories  which  lend  then- 
selves  to  quantification  would  of  oourse  be  nor*  effective  than  ones 
which  did  not. 


The  approach  outlined  Is  certainly  not  new  in  soienee)  in  fact.  It 
is  typical.  It  Is  stated  only  beoause  the  writer  has  not  seen  It  spelled 
out  In  writing  for  large-scale  tests  of  inqr  oonoepts.  Research  on  a 


•mllar  Male  oan  generally  ba  (tea  on  a non  rota  baa  1>)  for  sxauple, 
onoa  a criterion  la  established  for  day  or  night  firing  of  the  rifle, 
a training  pro  gran  oan  ba  oonetruoted  and  tea  tad  agalnat  the  axle  ting 
program.  Thla  la  a dlaorata  solution;  It  doaa  not  neoea sarlly  involve 
aatabllahlng  the  dimension  of  relatlonahlp  between  the  mrioua  poaalbla 
prograue.  In  the  propoaad  approach  qualities,  categories,  or  dlnenalone 
■oat  ba  established,  beoauae  of  the  great  nuabar  of  facto ra  which  affect 
the  final  product  and  the  need  to  allow  for  now  oondltiona  (aqulpnant 


The  propoaad  approach  doaa  not  naoaoaarlly  fall  entirely  within 
the  purr  lew  of  HumRRO.  Certainly  the  capabilities  of  humans  (including 
auoh  fee tore  aa  oapaelty  for  training  laadero)  are  an  important  consider- 
ation  In  establish^  the  rarloua  parameters.  The  general  approach  of 
quantifying  and  formulating  nay  11a  outside  HumRRO'e  responsibility,, 

But  the  quoatlon  might  arise,  "Whose  concern  la  it?" 


A.  The  Approaoh  to  Future  Toata 


Mow  equip— nt  and  waapona  are  being  developed  at  a rapid  rate. 
So—  weapons  hare  outputs  similar  to  those  of  standard  a ray  units  or 
■yet a—)  others  hare  outputs  whioh  the  standard  army  could  never  produce 
previously.  Row  developments  in  equipment  make  obsolete  some  old  types 
of  equipment,  and  In  other  oasea  asks  possible  things  that  oould  not 
previa— ly  ba  dome  at  all.  If  oh  oonaidered  only  the  weapons  and 
equips— rt  that  affected  outputs  whioh  are,  to  some  degree.  In  the 
standard  army's  repertory,  the  changes  in  any  structure  (organisation 


and  doctrine)  that  would  be  required  to  most  effectively  utilise  then 
would  not  be  great*  However,  new  weapona  and  equipment  can  produoe 
outputa  that  cannot  be  achieved  even  to  a degree  In  the  standard  any* 

The  Integration  of  these  new  outputs  will  have  far-reaching  laplioations 
for  Arsy  organisation  and  doctrine* 

As  long  aa  the  changes  In  structure  are  snail  there  will  be  a 
correspondence  between  the  standard  and  the  new  Any  units.  Older  these 
conditions  experienced  officers  can  coapare  the  outputs  of  units  in  the 
new  eye  tee  with  what  they  know  of  outputa  of  similar  units  in  the  stand- 
ard systems.  This  process  involves  a certain  amount  of  extrapolation, 
but  as  previously  stated,  this  is  not  necessarily  the  largest  source  of 
error  In  a test  of  this  type*  However,  as  changes  In  structure  require 
units  that  are  less  and  less  like  the  standard  units,  these  extrapolations 
will  bsoome  larger,  more  difficult,  and  subject  to  greater  error* 

The  ohangee  will  probably  oome  first  in  the  smaller  units  rather 
than  in  larger  organizations.  For  example,  new  capabilities  of  radio 
equipment  will  cause  changes  in  the  smaller  units  that  work  directly 
with  telephone  end  radio  equipment,  rather  than  in  the  Signal  Corps* 

And  If  atomic  sheila  for  1D5  howitzers  became  available  in  quantity, 
changes  In  the  organisation  of  howitzer  batteries  might  be  required 
(assuming  one  atomic  weapon  could  produoe  a saturation  casualty  effect 
in  an  area  that  previously  required  oontinual  fire  by  several  howitzers 
to  produce  saturation).  Such  <mpabilities  might  in  turn  produce  new 
equipment  requirements* 


Dm  ovhmII  output  of  tha  field  arwy  will  bo  tho  loot  to 
chon  go  ooepletely*  That  Is,  tho  dimensions  t y which  tho  over-all  output 
con  bo  dooorlbod  will  bo  appropriate  long  oftor  tho  dimensions  « pec  If  1b 
to  aubunlto  oro  outdated.  However,  the  quantities,  or  values,  on  theee 
over-ell  dimensions  will  change)  with  null  or  vnite  tho  dlaenslons  thaa- 
aelroo  will  chon  go.  Thi#  aey  bo  wean  bettor  in  terao  of  levels  of 
abet  root  Ion.  Tho  deeerlptlvo  tom  NoaiaolN  is  more  obotroot  than  "horse", 
"cow,"  "dusk,"  or  "pig."  Certain  prod  let  lono  about  the  behavior  of  all 
members  of  tho  animal  kingdom  oon  bo  Mdo  an  tho  baolo  of  tho  tom 
"anlaal,”  and  thoee  predictions  will  bo  useful.  For  lnstanoe,  wo  a ay 
predict  "aovaaont"  fbr  anlaalo.  This  prediction  will  bo  correct  for  a 


group  of  plgo,  horses,  and  oows  as  well  as  for  a group  of  chickens,  ducks, 
and  geese*  Of  course,  ty  being  aore  spoolflo  wo  aake  aore  accurate 
predictions)  predictions  of  anount  of  movement  will  be  aore  exact  If  wo 
use  tho  categories  of  quadruped  and  fowl,  rather  than  anlaal*  Both  kinds 
of  predictions  have  their  plaoe,  however. 

In  the  allltaxy  situation,  an  anqr  oan  bo  dooorlbod  in  aore 
abetroot  toms  than  those  used  to  describe  its  ooaponent  unite  anchor 
■jrstsaa.  Tha  useful  feature  of  the  aore  highly  abetraot  descriptions 
la  that  predictions  oon  still  bo  node  oven  if  the  components  change* 

Tho  following  selontlflo  prooedure  should  bo  considered  so  a 
gyetoaotlo  prooedure  for  aiding  tha  higher-level  officer  in  specifying 
tho  required  outputs  of  a field  azegr*  By  analysis,  tha  outputs  that  supply 
tho  boot  predictions  of  over-all  offaotivansaa  should  bo  Isolated*  Tho 


O 


categories  should  bo  genoml  enough  oo  that  now  weapons  and  equipment  oon 


b*  aubouood  mder  the  mm  nbrloa  M the  old,  Although  with  different 
voIum  of  output.  ThlA  that  tho  ootogorloo  would  bo  otruotured 

in  tom  of  output*.  Tho  objective  of  tho  procedure  1a  to  dovle*  control 
MtogorlM  thot  do  not  nood  to  bo  ohongort  qualitatively  in  ordor  to  in* 
tort  now  dowolopnonto.  Tho  ootogorlto  thould  bo  tuoh  thot  now  woopont 
ond  aqulpmnt  davolopnonto  con  bo  QMlgnort  now  quontitotiv*  values  In 
tho  old  unlto  of  nooourtwont.  Tho  funotlonol  relationships  ootobllohod 
with  tho  old  taIuoo  of  thooo  gonorol  ootogorloo  will  proov— obljr  hold 
with  tho  now  dowolopnonto.  Prediction*  eon  therefore  bo  no  do  by  entering 
tho  now  volute  In  tho  funotlonol  rolotlonohlpo  ond  then  oxtropolotlng  to 
tho  now  voIum  of  tho  other  fhnotlooolly  role  tod  ootogorloo  thot  will 
obtoln  with  tho  now  uoluo  thot  lo  onto  rod. 

To  111 uo trot*  thlo  procedure,  lot  no  oonoldor  tho  ootogorloo 
of  nobility,  flexibility,  Invulnerability,  ooooiond  control,  ond  fire 
power  - highly  obotroot  torn  currently  uoed  to  dooorlbo  tho  Any.  Thor* 
or*  funotlonol  rolotlonohlpo  between  th**o  ootogorloo,  but  what  th* 
rolotlonohlpo  ore  In  quantitative  tom*,  no  on*  knowa.  Betlnateo  of  tho 
quontltia*  am  o nottor  of  ort lotto  Judge ont  at  tho  prooont  tine. 

However,  It  do**  not  ino  unr*o*onohl*  to  bellovo  thot  tho  five  tamo 
eon  bo  quantified,  ond  after  quontif lootlon  they  oould  bo  funotlonolly 
rolotod  to  each  other  in  useful  quant ltotlvo  tome.  Otnoo  thooo  quontl* 
flection*  ond  fractional  rolotlonohlpo  wore  developed,  extrapolations  to 
oltuotlono  Involving  now  aqulpmnt  and  woopono  oould  bo  node  with  ooouroqr 
and  Mouronoo  mthor  than  on  on  ortiotlo  boolo.  It  lo  orguod  hero  thot  oo 


the  Angr  ohangoe  wore  and  nor*  tram  ths  standard  inqr  with  which 
experienced  offioerr  ara  fanilUr,  thair  artiatio  extrapolations  fro* 
oonbat  will  hara  to  bo  greater  and  consequently  no  re  subject  to  orror. 
Again,  It  la  not  argued  that  tha  fire  oatogorlos  dlaouaaad  ara  tho  noet 
uaaful  itlnanalnna  for  doaorlblng  tha  Arnyi  thay  wara  aalactad  aiwply 
aa  axwsploo.  Thagr  ara  oummtly  In  uaa  hjr  An^r  officara,  though  not  In 
a quant itat  ire  or  Ainetloaally  ralatad  aanaa. 

Tha  point  la  that  tha  trap  plana  for  raorganlaatlona  naoaaaltatad 
by  new  waapona  and  aqulpwant  oan  bo  approached  solantlf  loally . further, 
it  la  arguad  that  auoh  an  approach  deal a with  tha  Anv  as  a whole  rather 
thm  slaply  with  aapaota  auoh  aa  training,  aalaotion,  and  opera tiona . 

Thaaa  aapaota  fit  within  tha  larger  aolantlflo  framework  and  preeunably 
all  of  thaw  are  atrueturad  by  tha  owar-all  picture. 

Tha  effaot  of  tha  orar-all  approach  suggested  hara  would  probably 
be  to  prowlda  a certain  kind  of  continuity  for  tha  ehangee  which  will  be 
wada  during  future  years.  We  night  say  that  tha  dlaanaiona  of  change 
will  be  Identified. 

Thera  la  no  reason  why  thaaa  dlwanalona  cannot  bo  put  Into 
language  fbr  A ray  ooneuwptlon.  Knowing  tho  dlwanalona  of  change  wight 
have  an  axtrenely  tangible  and  ealutary  affect  on  noat  Any  operations.- 
One  effaot  eight  bo  that  of  orienting  Any  poreonnal  at  all  oehalona  to 
"where  they  are  going,"  how  their  job  will  change,  eto.j  auoh  knowledge 
would  pooaibly  renews  tha  disrupt  lee  peraonal  aapeot  frow  tho  ohangoe. 
Subjectively,  tha1 proooaa  would  bo  a continuous  on#  rather  than  the 
"orooh  change"  process  It  la  now  and  will  be  with  further  ehangee.  This 
kind  of  banoflt  would  bo  added  to  tho  offsoto  on  training,  aalaotion, 
pro  omen  ant,  and  other  opa  rat  Iona. 


In  mw  wag « this  section  would  seam  to  negate  sows  of  tbs 
points  suggested  earlier.  That  is,  it  was  previously  suggested  that 
the  recollections  of  eaperlanoed  Axwy  personnel  could  serve  as  a control 
under  certain  circusstanoee,  and  also  that  the  Measurement  of  the  final 
over-all  output  of  the  field  army  was  highly  contaminated.  Actually 
there  Is  no  oonflict  In  either  case.  They  both  Involve  the  time  factor. 

At  present,  experienced  personnel  can  make  certain  comparisons  of  the 
standard  and  "new*  armies,  but  in  the  future  they  will  not  be  able  to 
■alee  those  asms  comparisons  because  the  new  units  will  not  correspond  to 
the  old.  the  oase  of  measuring  the  final  product  of  the  field  uxmy  Is 
similar . In  SAGEBRUSH  so  maqjr  factors  were  confounded  that  it  was  Im- 
possible to  untangle  than  in  the  output  of  the  field  arnyj  however, 
this  need  not  always  be  the  oase.  In  fleet,  it  Is  reasoned  hers  that 
the  contaminating  factors  will  haws  to  be  controlled,  because  we  cannot 
continue  to  measure  and  compare  outputs  Aram  subunits  as  these  unite 
lose  their  ident  In  the  new  organisations. 

In  offset  those  points  represent  e recognition  that  officer 
Jnrtpiente  constitute  good  prediction  at  the  present  time,  but  that  they 
will  lose  predictive  poser  In  the  fUturej  e program  baaed  on  tests  of  the 
over-all  output  of  the  field  sngr  will  have  to  be  developed  before  accurate 
predictions  can  be  made  In  the  future. 

B.  Future  Teat  Tehiolee 

Will  teste  of  future  organisation  and  doctrine  use  maneuvers 
sush  as  SAGEBRUSH  as  a vehicle?  It  seams  to  the  writer  that  maneuvers 
oamot  do  the  Jobj  at  any  rats,  not  t y thorns# Ives.  Extensive  testing  of 
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aitbHgnWa  and/or  units  in  required  to  "shako  than  down"  before  a 
"•nearer,  tout  aside  ffta  this,  n maneuver  has  lnharant  disadvantages . 

Moat  of  thaaa  can  too  oorered  in  tha  statement  that  mamuvera  cost  too 
■uah  in  tame  of  time,  money,  and  disruption  of  othar  activities. 

Nothing  haa  baan  said  about  tha  N of  SAOBBRUSH  teat.  But  it 
uaa  ooa.  Naan  if  thsrs  had  baan  no  contaminating  factors  and  all  naaauraa 
had  toaan  perfaot,  tha  N would  a till  too  one.  SAOBBRUSH  was  conducted  in  a 
glwrn  terrain,  weather,  and  roadnet  situation.  And  aoat  Important,  the 
split  of  log  1st io  aupport  from  tactical  comnand  depended  in  great  measure 
on  the  react  Iona  and  personal  it  lea  «**“  4 he  specif  to  nnawan  flare  involved 
for  its  suooees  or  failure.  Bren  with  tha  beat  test  of  this  particular 
sat  of  oonnanders,  the  question  of  how  wall  it  would  work  with  other 
commanders  would  remain  problematical.  However,  the  expense  of  obtain- 
ing a sufficient  N would  probably  be  prohibit  ire.  These  points  underline 
onoe  again  the  necessity  of  developing  predictive  teats  which  hare  fewer 
elements  than  the  test  orlterlon. 

Tha  abetraotlre  work  of  scientists  and  officers  might  be  facil- 
itated by  tha  uaa  of  electronic  computers;  these  would  certainly  solve 
the  problem  of  N.  Parameters  for  the  machine  could  be  collected  from 
maneuvers,  oombet,  war  games,  end  CPI's.  New  organisations  of  tha  Army 
oould  be  "played"  by  oowandsra  end  their  staffs,  with  maohlnes  rather 
than  actual  troops  used  ee  subunite.  Machine  "wars"  oould  be  played  on 
two  aides.  The  same  "war"  oould  be  fought  with  different  oo wanders, 
different  terrain,  different  weather,  end  what  is  aoat  important. 


different  field-army  structures.  Sleet ronio  computers  Mgr  not  be  the 
answsr  to  the  R problem,  but  there  1 » e need  for  an  ebetreet  teat  that 
ean  be  repeated  under  controlled  eonditione  et  e reasonable  expense. 

Maneuvers  oould  be  used  as  a validity  cheek  on  the  results  of 
electronic  ear  feeing  or  other  abstract  tests  that  eight  be  developed. 
This  would  provide  a test  criterion  in  which  the  Army  oould  aalntaln 
oontrol  of  the  freee  of  refsrenoe. 

Enough  data  would  be  obtained  from  the  electronic  war  gauss  to 
describe  the  functional  relationships  (curves)  for  weather,  terrain, 
roadnet,  and  all  those  factors  whiwu  will  be  constant  in  a given  maneuver 
Predictions  oould  be  made  from  the  electronic  data  for  a given  set  of 
conditions,  chosen  at  random)  those  conditions  oould  then  be  duplicated 
for  a maneuver  and  the  electronic  predictions  validated  on  the  maneuver 
outcome.  The  accuracy  of  this  prediction  would  serve  as  an  index  of 
validity  for  all  the  functional  relationships  developed  by  the  electronic 


I*  Probability  of  The  Inclusion  of  Testa  in  Putura  Maneuvers 


Some  kind  of  empirical  testing  will  probably  ba  dealrad  for  tha 
Anv'i  n ew  thooratleal  Oonoapta  of  reorganisation*  Tbia  Judgment  la 
baa  ad  on  tha  opinion  that  tha  raeulta  of  tha  BLUEBOLT,  POU, OW  MB,  and 
SAOEBRUBH  taota  will  produce  noough  new  Information  on  tha  ATM  oonoapta 
for  OOKARC  to  oonaldar  than  to  ba  of  value.  Alao,  alnoa  "test"  generally 
has  a posit Ira  valence,  "test"  raeulta,  will  ba  desired  In  tha  future 0 
Not  enough  la  known  about  such  large-scale  "testa”  aa  SAQEBRUSH  to  permit 
a correct  evaluation  of  their  validity*.  As  long  aa  there  are  no  well- 
known  ways  of  distinguishing  dsgrsea  of  validity  for  those  tests  any 
kind  of  test  will  be  considered  adequate*  finally,  a precedent  exists 
for  tasting  oonoapta  Ilka  ATPA,  which  restructure  tha  Any,  by  naans 
of  nanouvers.  This  procedure  la  likely  to  oontlnue  until  other  proce- 
dures are  demons t rated  to  ba  batter* 


Tha  nature  of  tha  next  maneuver  test  of  doctrine  and  organisation 
will  be  similar  to  that  of  the  SACK  BRUSH  test  unless  a scientific 


advisory  group  suggests  another  approach*  If  tha  procedures  used  by  the 
AMTBO  In  SAGEBRUSH  provide  satisfactory  Information  the  sane  procedure 
will  be  followed  again* 

II*  Aaaunlng  That  HunRRO  Does  Not  Participate 

The  following  predictions  are  based  on  the  assumption  that  HunRRO 
will  not  participate  In  future  naneuver  tests*  It  Is  predicted  that. 

In  the  abeenoo  of  a scientific  adviser  from  HunRRO,  the  AMTBQ  testing 
procedures  will  not  be  used  In  the  way  they  were  deelgned  to  be  used* 

In  this  event  the  testing  agency  will  be  dissatisfied  with  the  procedures 
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and  will  recommend  new  procedures  for  the  next  maneuver o The  reoom- 
mendatlon  will  very  likely  take  the  line  that  testing  with  questionnaires , 
objectives,  and  subobjectives  Is  a waste  of  time,  and  that  experienced 
officers  do  not  need  all  this  to  do  their  Jobo  The  testing  agency  will 
probably  recommend  that  more  officers  serve  as  evaluators  and  that  fewer 
"long  hair"  techniques  be  employed.,  This  recommendation  will  probably 
be  followed,  which  will  put  the  situation  back  where  it  was  with  the 
test  of  the  Triangular  Division  In  1939°  The  cycle  will  then  pro'ably 
repeat  itaelfo 

If  HumRRO  were  to  continue  participation  by  the  assignment  of  a 
scientific  adviser  for  brief  periods,  the  type  of  test  conducted  for 
SAGEBRUSH  would  probably  continue  as  long  as  he  was  so  assignede  In  the 
opinion  of  the  writer,  the  adviser  could  do  no  more  than  sustain  the 
present  procedures  in  the  amount  of  time  he  would  be  able  to  devote  to 
the  job.  Considered  In  terms  of  the  writer's  thesis  that  the  present 
procedures  will  become  ineffectual  as  the  Amy  changes  more  and  more 
from  its  current  structure,  such  action  by  HumRRO  would  not  contribute 
much  to  the  effectiveness  of  the  tests ° 

The  Implications  of  greater  degrees  of  HumRRO  participation  are 
obvious.  In  the  writer's  view  any  participation  should  follow  the 
direction  described  in  this  report.  Following  such  a course  would  be 
desirable  from  the  standpoint  of  developing  effective  testa  for  future 
reorganisation,  but  it  would,  of  courea,  lead  to  other  problems ° For 


O 


example,  the  question  of  whether  this  is  a legitimate  HumRRO  activity 
would  arias  aa  would  the  question  of  how  much  effort  can  be  expended  c 


The  writer  la  mi  attempting  to  answer  these  quaatiansi  In  developing 
hla  ideas  of  vliot  o tooting  progroo  will  boro  to  bo  to  bo  effeotlro  In 
tho  future  ho  gave  no  consideration  to  vhothor  HuedUto  hod  oognlooneo 
or  In torso t in  tho  oroo. 

III.  Advantaaoa  to  HubRHO  Portlolpotlon 

Tho  thoorloo  of  orgonlsotlon  and  doctrine  envisioned  for  the  A rwy 
of  tho  futuro  Imply  rothor  wldo  doporturoa  from  tho  prooont  Aroy.  Thooo 
chongoa  laply  that  activities  of  Individuals  and  groupo  will  diffor 
markedly,  and  undor  thooo  olrowstanees  Individuals  oust  presumably  bo 
trolnod  differently.  for  example,  tho  wider  diaporolon  that  will 
charaeterlao  tho  amiea  of  tho  atomic  ago  noana  that  patrol*  will  be 
able  to  ponotrote  deeper  and  more  often  Into  the  area  occupied  by  dia- 
peroed  enemy  troops.  Patrol  action  over  wider  aroaa  and  In  penetration 
of  several  olios  will  moan  that  the  patrol  Banters  will  not  personally 
observe  their  routes  before  the  patrol  begins.  This  in  turn  will  naan 
a greater  training  enphaala  on  nap  navigation  than  on  navigation  by 
previous  observation. 

All  aueh  differences  In  aotivity,  and  they  are  probably  legion, 
point  to  oodlfloatlona  In  training.  Bigger  training  Modifications  will 
result  directly  from  the  Introduction  of  new  equips  ant  and  weapons.  The 
training  prograoo  for  now  weapons  and  equipment  are  not  generally  In 
OKlstenon  be  lb  re  the  "hardware"  la  available  In  quantity,  and  the 
possibility  also  satiate  that  new  equipment  and  weapons  will  aalce  certain 
current  activities  obsolete.  It  aeons  to  be  to  Humiffl's  advantage  to 
know  what  ohangeo  will  ooour,  and  to  tailor  lta  training  research 


aooordingly. 
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Information  on  projected  changes  will  not  be  available  in  concrete 
form,  since  a certain  amount  of  analysis  of  the  situation  is  required 
in  order  to  obtain  it*  In  the  writer's  opinion,  information  of  this 
kind  will  be  available  only  when  human-behavior  scientists  abstract  it 
during  a maneuver,  although  sons  of  the  more  obvious  differences  could 
probably  be  aaoertalned  from  analysis  of  the  concepts  themselves* 

fhe  important  point  la  that  prior  to  some  kind  of  analysis  this 
information  is  not  in  a usable  form*  In  order  to  learn  the  subject 
matter  which  they  can  then  analyte,  HumRRO  scientists  should  work  with 
the  Army  during  maneuvers* 

Three  points  have  been  made  in  this  section:  (1)  future  changes  in 
the  Army  will  be  manifest  in  maneuvers,  (2)  these  changes  have  important 
training  implications  for  HumRRO,  and  (3)  to  obtain  the  training  infor- 
mation, HumRRO  scientists  must  perform  on-the-spot  analyses  of  maneuvers 
and  of  ooncepta  as  wall* 

Such  analyses  would  benefit  the  ourrent  programs  in  which  HumRRO 
engages)  the  activity  of  planning  Anqy  theory  testing  programs  is  another 
matter*  The  question  of  whether  direct  benefits  would  accrue  from  par- 
ticipating In  such  an  area  should  be  considered  separately* 


